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1.0  TFVC  System  Overview  and  Design 

The  Traffic  Flow  Visualization  and  Control  (TFVC)  system  is  a  video-camera-based, 
wide-area,  traffic  surveillance  and  detection  system  that  provides  real-time  traffic  information  to 
traffic  management  center  operators.  TFVC  is  a  distributed  system  consisting  of:  (1)  a  network 
of  video  cameras  with  collocated  image  processors,  (2)  centralized  command,  control  and 
display  located  in  a  traffic  management  center  that  are  used  to  manage  the  system  and  its  data, 
and  (3)  a  communications  subsystem  that  links  the  remote  sensors  to  the  central  computer. 

TFVC  video  data  processors  use  advanced  image  processing  techniques  to  calculate 
traffic  flow  parameters  in  real-time  and  forward  the  data  to  the  central  computer.  Distributed 
image  processing  is  used  to  minimize  communications  requirements  and  to  maximize  the  content 
of  data  transmitted  to  the  traffic  management  center. 

The  TFVC  system  was  developed  to  work  with  a  spectrum  of  communications  media 
including  RF  cable  modems,  ISDN  and  POTs  (plain  old  telephone)  phone  lines,  and  wireless 
Ethernet.  TFVC  could  also  be  readily  adapted  to  work  with  fiber  optics  networks.  The 
bandwidth  of  the  communications  network  dictates  the  frequency  at  which  data  is  forwarded  to 
the  central  computer. 

The  TFVC  central  computer  monitors  commands  and  controls  system  resources.  It 
provides  a  graphical  user  interface  (GUI)  for  displaying  traffic  parameters,  video  images  and 
system  status,  and  it  manages  and  archives  system  data. 

Features  and  capabilities  of  the  TFVC  system  include  the  following: 

•  High-speed  processing  of  video  images  to  compute  traffic  volume,  density,  and  speed. 

•  Visual  monitoring  of  traffic  via  pan-zoom-tilt  control. 

•  Automatic  incident  detection  and  operator  notification. 

•  Automatic  return  to  presets  with  lane  verification  algorithms. 

•  Archival  of  historical  reduced  traffic  data  in  a  SQL  accessible  database. 

•  Presence  of  vehicles  in  lanes  and  shoulders. 

•  Occupancy  and  headway  (derived  from  traffic  data). 


The  TFVC  system  was  developed  in  collaboration  with  the  New  York  State  Department  of 
Transportation,  the  Federal  Highway  Administration,  and  the  US  Air  Force’s  Rome  Laboratory. 
In  June  of  1995  Kaman  Sciences  deployed  a  research  system  along  the  Long  Island  Expressway 
(LIE)  in  New  York  that  consisted  of  five  video  sensors  and  local  processors,  and  a  central 
computer  located  in  the  LIE’S  INFORM  Center.  (Note:  in  December  1997  Kaman  Sciences 
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Corporation  became  a  part  of  ITT  Industries  (ITT  Systems),  and  in  November  1997  Rome 
Laboratory  became  the  Air  Force  Research  Laboratory,  Information  Directorate.)  This  system 
demonstrated  system  feasibility,  tested  system  capabilities  and  interfaces,  and  collected  data  to 
refine  system  design,  construction,  and  operation.  In  October  of  1997,  Kaman  Sciences  began 
deploying  a  full-scale  system  of  19  sensors  along  the  LIE,  listed  below. 


Site  Direction  Location  Link 


K6 

West 

North  Ocean  Avenue  -  63  (NW  immediately  past  bridge) 

Wireless 

K5 

East 

Blue  Point  Road  (SE  .3  mile) 

Wireless 

K4 

West 

Waverly  Avenue  (NW  immediately  past  bridge) 

Wireless 

K3 

East 

Nicolls  Road  -  62  (SW  of  intersection) 

Wireless 

K2 

West 

Holbrook  Road  (NE  of  intersection) 

Wireless 

K1 

East 

Patchogue-Holbrook  Road  -  61  (NW  immediately  past  bridge) 

Wireless 

36 

East 

Hawkins  Avenue  -  60  (SW  -  after  2nd  bridge  -  pole  in  center) 

RF  modem 

35 

West 

Terry  Road  -  after  Ocean  -  59  (NW  of  intersection) 

POTS 

34 

West 

Veterans  Memorial  Hwy  -  57  (NW  immediately  after  underpass) 

POTS 

33 

West 

Wheeler  Road-Joshuas  Path  -  56  (NW  of  intersection) 

RF  modem 

32 

West 

Washington  Avenue  -  after  55  (NW  immediately  past  bridge) 

POTS 

26 

East 

Crooked  Hill  Road  -  after  53  bear  left  (SE  of  intersection) 

RF  modem 

25 

West 

Commack  Road  -  52  (NW  of  intersection) 

RF  modem 

37 

West 

West  bound  Rest  Stop  -  between  52/53  (NW  end  of  Rest  Area) 

RF  modem 

24 

West 

Deerpark  Avenue  -  5 1  (NE  .2  mile;  close  lane  for  bucket  truck) 

RF  modem 

23 

West 

Bagatelle  Road  -  before  50  (NW  .2  mile) 

RF  modem 

21 

East 

Route  110-49  (above  LIE  on  south  median) 

RF  modem 

20 

West 

Plainview  -  Washington  Road  (NE  of  intersection) 

RF  modem 

TABLE  1  TFVC  Site  Locations 

The  TFVC  system  uses  a  unique  method  of  video  sensing  which  automatically  detects 
traffic  patterns  present  in  a  captured  traffic  scene.  This  approach  begins  with  a  video  image 
which  is  obtained  from  the  output  of  an  off  the  shelf  camera.  The  camera  retains  its  original 
traffic  monitoring  capabilities  because,  after  initial  setup,  automatic  pan,  tilt,  and  zoom  hardware 
return  the  camera  to  preset  sensing  locations.  Image  processing  algorithms  developed  by  ITT 
automatically  verify  traffic  lanes;  the  image  within  those  lanes  is  processed  to  retain  only 
pertinent  traffic  information.  As  individual  frames  from  the  video  camera  are  analyzed,  the  main 
processor  extracts  the  traffic  data.  For  example,  overall  traffic  flow  speed  is  obtained  directly 
from  the  processed  traffic  image  for  each  direction,  individual  lanes  and  for  both  directions 
simultaneously.  The  processed  traffic  data  are  then  sent  to  a  control  center  for  further  analysis. 
The  archived  traffic  data  can  be  easily  accessed  by  any  SQL  compliant  database  (a  simple 
Microsoft  Access  application  program  was  developed  to  allow  a  quick  check  of  the  data).  In 
addition,  the  TFVC  GUI  can  analyze  and  display  on  its  console  historical  data  retrieved  from  the 
archived  traffic  database.  Government  purpose  license  rights  are  in  effect  for  specific  portions  of 
the  TFVC  system.  For  more  information  contact  ITT  Systems  (bob.larson@ssc.de.ittind.com)  or 
the  Air  Force  Research  Laboratory. 
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2.0  System  Description 


The  following  figure  shows  the  major  TFVC  system  components:  Sensor,  Graphical  User 
Interface  -  GUI,  Database  Server,  and  Network.  Each  will  now  be  described.  Technical 
specifications  and  details  are  included  in  the  TFVC  Hardware  Systems  Manual. 


FIGURE  1  System  Description 


2.1  SENSOR 

2.1.1  .  Functional  Characteristics.  The  remote  video  sensor  is  responsible  for  acquiring 
and  processing  scene  images,  computing  traffic  parameters,  and  forwarding  data  to  central 
computers.  The  specific  functions  are  described  in  the  following  sections. 

2.1.2  The  TFVC  Sensor  is  capable  of  simultaneously  processing  information  from  up  to 
four  (4)  separate  video  sources  including  Video  Cameras,  CCTV  video  image  sensors  and  video 
tape  players.  The  video  sources  may  be,  but  are  not  required  to  be,  synchronized  or  line  locked. 
The  video  is  digitized  and  analyzed  at  a  rate  of  60  fields  per  second.  Each  of  the  4  video  cameras 
may  be  used  for  surveillance  when  installed  with  an  optional  Pan/Tilt/Zoom  system.  This  is 
accomplished  through  the  use  of  a  video-multiplexing  switch  in  the  camera  control  board. 
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Because  the  switch  must  share  resources  between  cameras,  some  performance  degradation  is 
seen  for  greater  numbers  of  cameras  used. 

The  SENSOR  is  able  to  detect  and  provide  traffic  parameters  in  a  minimum  of  seven 
regions  within  each  of  the  video  cameras  Field  Of  View  (FOV). 

The  SENSOR  is  able  to  capture  and  transmit  to  the  Control  Center  System  (CCS)  or 
traffic  controller  a  black  &  white  or  color  video  snapshot  of  the  video  camera  field  of  view.  The 
update  rate  for  the  snapshot  depends  upon  the  bandwidth  of  the  network  and  varies  between  2  to 
3  frames  per  second  to  2  to  3  seconds  per  frame.  With  an  adequate  communication  infrastructure, 
motion  video  could  be  transmitted. 

The  SENSOR  is  able  to  report  to  the  CCS  hardware  status  and  system  temperature  for 
diagnostic  purposes. 

The  SENSOR  is  designed  to  use  TCP/IP  as  a  communication  protocol  for  interface  to 
various  communication  architectures.  These  include  Plain  Old  Telephone  Service  (POTS), 
Integrated  Services  Digital  Network  ISDN,  wireless  Ethernet,  RF  cable  modem,  and  fiber. 

When  installed  with  the  optional  Pan  Tilt  Zoom  unit  the  SENSOR  is  able  to  control  pan, 
and  tilt  functions;  no  external  control  is  required.  All  TFVC  configurations  are  capable  of 
controlling  the  zoom,  focus  and  iris  mechanism  of  each  video  camera. 

2.1.3  Video  Camera.  TFVC  is  capable  of  using  the  output  of  off  the  shelf  cameras  that 
comply  with  the  standards  defined  in  the  following  sections.  The  SENSOR  requires  a  video 
camera  that  supplies  RSI 70 A  NTSC  video.  The  video  camera  must  have  a  remotely  controllable 
lens  with  manual  zoom,  focus  and  iris  control  operating  from  +/-  8  volts  DC.  If  the  system 
requires  complete  surveillance  capability  each  video  camera  site  will  have  a  pan  and  tilt 
assembly  capable  of  an  accuracy  and  repeatability  of  0. 1  degrees.  Each  pan  and  tilt  assembly  is 
capable  of  storing  32  mechanical  presets,  including  pan,  tilt,  zoom,  and  focus  settings  and  must 
support  a  differential  RS-422  communication  link.  The  video  camera  enclosure  is  capable  of 
withstanding  typical  roadside  environments  with  automatic  heating,  defrosting  and  cooling.  The 
video  camera  enclosure  contains  a  wiper  for  adverse  weather  conditions.  Some  performance 
degradation  is  seen  when  the  wiper  is  used.  In  addition,  adverse  weather  causing  swaying  in  the 
sensor’s  pole  can  result  in  some  degradation. 

2.1.4  Traffic  Regions.  TFVC  is  capable  of  generating  traffic  parameters  for  the  seven 
different  regions  shown  and  defined  in  the  sections  that  follow.  The  SENSOR  calculates  Flow 
Speed,  Density,  and  Volume  for  these  lanes:  The  high  occupancy  vehicle  (HOV)  region,  lane  1, 
lane  2,  lane  3,  the  left  shoulder  lane,  the  right  shoulder  lane,  and  the  far  lane  (defined  as  a 
collection  of  all  lanes  in  the  roadway  at  a  point  that  begins  beyond  the  6  main  lanes).  Occupancy 
and  headway  parameters  are  readily  derived  from  this  data.  Presence  of  vehicles  in  the  left  or 
right  shoulder  handled  can  be  determined. 

2.1.5  Traffic  Parameters.  The  traffic  parameters  obtained  by  the  TFVC  system  are 
Flow  Speed  (miles  per  hour).  Density  (vehicles  per  mile),  and  Volume  (vehicles  per  hour).  The 
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definition  and  accuracy  of  each  parameter  is  given  in  the  following  sections.  Occupancy  and 
headway  parameters  are  readily  derived  from  this  data. 

2.1.6  Incident  Detection.  The  SENSOR  monitors  all  lanes  within  the  field  of  view  and 
is  capable  of  detecting  incidents.  Congestion  is  detected  using  threshold-based  algorithms 
developed  by  ITT  traffic  engineers  and  scientists.  The  threshold-based  algorithm  is  discussed  in 
section  3.3.1  and  section  5.0. 

2.1.7  Environmental  and  Mechanical  Requirements.  The  SENSOR  operates  reliably  in 
the  adverse  environment  found  in  the  typical  roadway  traffic  cabinet.  The  SENSOR  is  capable 
of  operating  from  -32  to  60  degrees  C  outside  ambient.  The  SENSOR  consumes  less  than  800 
watts  when  connected  to  120  volts  60  Hertz  AC  source.  Mechanical  Requirements.  The 
SENSOR  is  19-inch  rack  mountable.  Nominal  outside  dimensions  not  including  connectors  is 
9.5”  x  17”  x  13.5”  (H  x  W  x  D).  The  SENSOR  weighs  35  pounds  not  including  external 
connectors. 

2.1.8  Interface 

•  AC  power  connections  are  made  to  an  IEC  320  power  line  inlet. 

•  Interconnection  to  the  Video  Camera  is  made  through  a  dual  13  point  barrier 
strip  capable  of  supporting  16  AWG  wire  and  a  single  BNC  connector  for 
video. 

•  Interconnection  to  the  Serial  communication  port  is  made  to  a  male  9  pin  D 
connector. 

•  Interconnection  to  the  Ethernet  communication  port  is  made  to  a  female  RJ-45 
connector. 

•  Interconnection  to  POTS  communication  port  is  made  to  a  female  RJ-45 
connector. 

•  Interconnection  to  ISDN  communication  port  is  made  to  a  female  RJ-45 
connector. 

•  Fiber  optic  interface  is  made  with  standard  fiber  optic  connectors  and  network 
adapters. 

•  Wireless  interface.  Connection  to  TFVC  sensors  is  via  lOBaseT  RJ-45 
crossover  cables  or  using  standard  lOBaseT  cables  with  a  small  mini  hub, 
which  utilizes  standard  RJ-45  connections. 

2.2  Graphical  User  Interface  -  GUI 
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2.2.1  The  GUI  simultaneously  processes  all  traffic  parameters  from  all  of  the  Remote 
Video  Sensors.  It  displays  the  results  of  all  traffic  parameters  in  a  graphical  representation.  It 
displays  black  &  white  or  color  video  transmitted  from  the  SENSOR  at  update  rates  that  depend 
on  the  network  bandwidth.  The  GUI  alerts  operators  of  any  out  of  bound  SENSOR  status  and 
temperature.  It  is  capable  of  alerting  operator  of  any  incident  detected.  It  is  capable  of  pan,  tilt, 
zoom,  focus,  and  iris  control  of  the  video  cameras  attached  to  the  SENSOR.  The  GUI  uses 
multiple  communication  protocols  for  interface  to  various  communication  architectures.  TCP/IP 
is  used  to  communicate  with  the  sensors.  Other  common  networking  protocols  such  as  TCP/IP, 
IPX/SPX,  and  NetBEUI  can  be  used  to  interface  to  the  GUI  on  a  LAN.  The  GUI  is  able  to 
remotely  setup  and  configure  a  SENSOR.  The  GUI  software  can  be  run  on  any  workstation 
running  Microsoft  Windows  NT  3.51. 

2.3  Database  Server  -  DB 

2.3.1  The  Database  Server  polls  all  traffic  and  Health  /  Status  parameters  from  all  of  the 
Remote  Video  Sensors.  It  logs  all  data  into  the  SQL  database  using  Microsoft  SQL  Server 
version  6.0.  The  DB  is  able  to  display  the  results  of  a  database  SQL  query. 

2.4  Network 

2.4. 1  The  SENSOR  provides  a  convenient  interface  to  all  wireless  Ethernet,  RF  coaxial 
cable,  fiber,  and  phone  (both  ISDN  and  POTS)  communication  links  described  in  this 
specification. 

2.4.2  Types 

•  RF  Cable  Modems.  The  TFVC  SENSOR  can  interface  to  RF  cable  modems 
operating  over  existing  coaxial  cable. 

•  Plain  Old  Telephone  System  (POTS).  The  SENSOR  is  capable  of 
transmitting  data  over  POTS  link  at  a  rate  of  28.8  Kilobits  per  Second 
(KBPS).  All  lines  provide  for  surge  suppression.  The  link  uses  adaptive 
speed  leveling  for  poor  line  conditions,  error  control  to  maintain  data 
integrity,  and  data  compression  for  increased  data  throughput. 

•  Integrated  Systems  Digital  Network  (ISDN).  The  SENSOR  is  capable  of 
transmitting  data  over  two  64  KBPS  bearer  channels  and  one  data  channel. 
This  protocol  is  commonly  known  as  a  Bearer  Rate  Interface  (BRI).  The 
effective  throughput  rate  is  96  KBPS  full  duplex.  All  lines  provide  for  surge 
suppression. 

•  Wireless  Ethernet.  The  SENSOR  is  capable  of  transmitting  data  over  a  2 
Megabits  per  Second  (MBPS)  wireless  Ethernet  link.  The  Wireless  Ethernet 
media  runs  at  2.4  Ghz  spread  spectrum.  The  wireless  bridges  operate  in  the 

2.4  GHz  range  using  a  spread  spectrum  technique  that  increases  security  and 
boosting  data  integrity.  The  Wireless  Ethernet  option  requires  that  line-of- 
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sight  be  maintained  between  antennas  at  adjacent  sites  without  obstruction. 

•  Fiber.  The  TFVC  sensor  is  readily  adaptable  to  fiber  optic  networks.  The 
high  bandwidth  of  fiber  will  greatly  enhance  the  performance  of  the  system, 
especially  the  video  frame  rate  update. 

3.0  Summary  of  Technical  Work  Accomplished 

3.1  Hardware  Subsystems 

3.1.1  An  innovative  modular  sensor  subsystem  was  developed  that  locally  housed  the 
image  processing  and  control  equipment  for  TFVC.  The  design  for  this  used  cost  effective,  off- 
the-shelf  hardware.  The  TFVC  sensor  realizes  a  distributed  architecture  design  that  maximizes 
the  networking  resources  employed.  This  subsystem  includes  a  camera  controlled  by  an  adaptive 
auto  iris  for  contrast  control.  A  customized  Pan/Tilt/Zoom  mechanism  was  developed  to 
accurately  return  the  camera  to  a  predetermined  view.  The  processor  uses  a  single  Intel  Pentium 
chip  and  common  frame  grabber  boards;  this  design  can  be  leveraged  for  increased  performance 
as  this  hardware  state  of  the  art  advances. 

3.1.2  The  network  subsystem  reflects  flexibility  and  adaptability  for  creative  use  in  a 
wide  variety  of  situations.  RF  cable  modems  can  be  used  with  TFVC  when  cable  backbones  are 
present  in  the  existing  infrastructure.  Plain  old  telephone  systems  (POTs)  and  a  wireless 
Ethernet  option  bound  the  bandwidth  possibilities  developed  on  the  project.  A  discussion  of 
ISDN  and  fiberoptic  implementations  are  included  in  this  report. 

3.2  Software  Developed 

3.2.1  Software  developed  for  the  sensor  subsystem  represents  some  of  the  most  creative 
work  done.  Efficient  flow  speed  algorithms  developed,  coded,  and  tested  under  the  TFVC  project 
allowed  for  accurate  calculations  of  traffic  parameters  using  the  cost  effective  hardware  design. 
(This  work  is  summarized  in  appendix  A.)  Incident  detection  methods  were  developed  to 
automatically  notify  the  operator  of  a  potential  problem,  based  on  the  flow  speed  parameters 
over  time.  Communications  and  TCP/IP  sockets  solutions  were  also  developed.  Software  for 
compressing  JPEG  image  data  for  transmission  over  network  media  was  also  developed. 

3.2.2  GUI  application  software  to  facilitate  control  of  the  TFVC  system  as  well  as 
display  of  system  data  and  parameters  was  written  in  an  object-oriented  manner  using  Microsoft 
Visual  C++  and  Microsoft  Foundation  Classes.  The  application  made  it  easy  to  view  the  status  of 
the  entire  system  and  also  image  data  from  selected  sensor  sites. 

3.2.3  The  database  application  was  developed  to  archive  system  data  for  later  analysis. 
This  program  interfaces  to  an  MS  SQL  Server  database  for  easy  access  by  any  SQL  compliant 
method.  The  application  also  polls  each  of  the  sensors  regularly,  automatically  retrieving  the  data 
from  the  sensors.  It  also  allows  the  user  to  easily  query  the  database  of  traffic  data. 

3.3  Incident  Detection  Algorithms 
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3.3.1  The  initial  incident  detection  philosophy  during  the  development  of  the  TFVC 
system  was  to  combine  as  many  traditional  traffic  parameters  as  necessary  with  efficient  and 
accurate  artificial  neural  networks  (ANNs)  to  provide  reliable  (low  false  alarm  rate)  incident 
detection.  Other  methods  that  were  also  explored  included  threshold-based  algorithms  and 
horizontal  movement  detection  by  checking  regions.  This  was  done  from  single  sensor  and 
multiple  sensor  data  sources.  Ultimately,  a  wide  area  solution  was  sought  as  opposed  to  a  point 
case  (grain  of  sand)  solution.  Threshold  based  algorithms  examined  flow  speed,  volume,  and 
density  over  a  period  of  time  and  compared  them  with  operator  selected  values.  Ultimately  the 
threshold-based  approach  was  implemented  in  the  TFVC  MC  code. 

3.4  Innovations  in  Artificial  Intelligence  Traffic  Control 

3.4.1  ANN  approaches  to  incident  detection  used  the  current  and  two  previous  values 
for  flow  speed,  density,  and  volume  as  well  as  time  of  day  and  day  of  week  to  train  standard 
multi-layer  perceptron  neural  network  backpropagation  algorithms  with  forward  and  backward 
training.  This  resulted  in  up  to  1,830  total  inputs  for  three  lanes  and  three  parameters  from  time, 
day  and  date.  ANN  outputs  examined  were  1)  congested  conditions,  2)  roadway  obstruction,  and 
3)  possible  accident  --  for  a  total  of  three  outputs.  Multi-sensor  methods  were  also  studied  to 
combine  data  from  more  than  one  site. 

3.5  Reference  Documentation 

Traffic  Flow  Visualization  and  Control  System  (TFVC)  Preliminary  Design  Review  Final 
Report  CDRL  A003,  K95-23U(R),  24  March  1995. 

Traffic  Flow  Visualization  and  Control  System  Design  Plan  CDRL  A008,  K95-12U(R), 
28  March  1995. 

Traffic  Flow  Visualization  and  Control  System  Safety  Hazard  Analysis  Report  CDRL 
A011,  K95-10U(R),  13  April  1995. 

3.6  Environmental  Screening  Test  Plan 

3.6.1  This  section  details  the  environmental  test  procedures  for  the  TFVC  Remote 
Sensor  Subsystem  (RSS).  It  is  intended  that  the  RSS,  made  up  of  commercially  off  the 
shelf  (COTS)  sub-assemblies,  be  dedicated  for  use  under  adverse  field  conditions  through 
testing.  The  ITT  supplied  Central  Control  Subsystem  (CCS)  will  not  be  subjected  to  ESS 
testing  since  the  unit  will  be  used  in  a  favorable  control  room  environment. 

3.6.2  Referenced  Documents 

•  MIL-STD-785,  Task  301  Environmental  Stress  Screening  (ESS) 

•  MIL-STD-8 1 0E  Environmental  Test  Methods  and  Engineering  Guidelines 

A  summary  of  ESS  testing  is  shown  in  Table  2. 
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Bum-in  for  100  hours. 

Functional  test  prior  to  and  after  bum- 
in.  Heart  beat  monitored  during  bum- 
in. 

Temperature  cycling  3  cycles  0  to  55 
degrees  C. 

RTD  mounted  centrally  within  the 

RSS.  Functions  tested  prior  to,  during 
and  after  temperature  cycling. 

Thermal  protection,  safe  system 
shutdown  verification,  1  hot  cycle 
greater  than  60  degrees  C. 

Verify  system  shuts  down  and  auto  re¬ 
boots. 

TABLE  2  ESS  Testing 

3.6.3  Failure  Criteria.  Troubleshooting  of  a  discrepancy  and  retest  of  the  discrepant 
item  will  be  at  the  direction  of  the  program  manager.  As  a  minimum,  after  the  discrepancy  has 
been  corrected,  testing  will  proceed  with  the  last  successful  test  completed. 

3.6.4  Bum-In  Test.  This  test  detects  material  and  workmanship  defects  that  occur  early 
in  the  component  life  (infant  mortality).  The  minimum  bum-in  time  for  the  RSS  prior  to 
exposure  to  temperature  cycling  will  be  100  hours.  Bum-in  will  be  conducted  at  bench  level  in 
lab  environment.  The  RSS  will  not  be  installed  in  the  330  enclosure.  The  RSS  will  be 
instrumented  and  tested  as  stated  in  Functional  Test  A  prior  to  starting  bum-in.  Heartbeat  will  be 
monitored,  as  a  minimum,  for  the  100  hours  of  bum-in.  Functional  tests  may  be  conducted 
anytime  during  the  bum-in  period  to  detect  early  failures  rather  than  waiting  for  the  100  hour 
post  bum-in  test  to  detect  bum-in  failures.  Once  bum-in  has  been  successfully  completed,  the 
unit  can  now  be  subjected  to  ESS  Temperature  Cycling. 

3.6.5  Temperature  Cycling  Test  (ESS).  This  test  detects  material  and  workmanship 
defects  while  demonstrating  field  worthiness  of  the  COTS  subassemblies  selected  for  the  use  in 
the  RSS,  in  addition,  verification  of  the  RSS  internal  environment  control  systems  will  be 
demonstrated.  Refer  to  Figure  2  during  the  following  discussion. 

The  RSS  will  be  subjected  to  three  (3)  temperature  cycles  from  0  to  55  degrees  C.  A 
fourth  high  temperature  cycle  greater  than  or  equal  to  60  degrees  C  will  be  performed  to  verify 
the  over-temperature  safe  system  shutdown  and  re-boot  system  performance.  The  RSS  will  be 
placed  in  a  suitably  sized  environmental  chamber.  (Note:  The  RSS  will  riot  be  installed  in  the 
330  enclosure).  Once  placed  in  the  chamber,  as  a  minimum,  one  (1)  RTD  will  be  affixed 
centrally  within  the  RSS.  This  RTD  response  will  be  the  controlling  temperature  for  controlling 
purposes.  Chamber  ambient  air  will  be  observed  using  the  chamber  controller  display.  The  RSS 
will  be  instrumented  and  tested  as  stated  in  the  Functional  Test  B  procedure  during  temperature 
cycling  activities.  Prior  to  starting  the  temperature  cycle  test,  a  functional  test  (Functional  Test 
A)  will  be  conducted  at  room  temperature.  Once  successfully  completed,  the  RSS  is  turned  off 
and  ready  to  begin  the  3  temperature  cycles.  A  temperature  cycle  begins  with  the  RSS  at  room 
temperature.  With  the  RSS  turned  off,  the  chamber  ambient  air  is  reduced  to  -10  degrees  C. 
(Note:  An  overshoot  by  5  degrees  C  (-15  degrees  C)  will  accelerate  the  temperature  transition  of 
the  RSS  mass.)  Once  the  RTD  mounted  in  the  RSS  has  reached  -10  degrees  C,  the  RSS  is  turned 


9 


on  and  tested  in  accordance  with  Functional  Test  B  procedure.  Once  completed  with  the  RSS 
remaining  on  the  chamber  ambient  air  is  then  increased  to  55  degrees  C.  (Note:  An  overshoot  by 
5  degrees  C  (60  degrees  C)  will  accelerate  the  transition  of  the  RSS  mass).  Use  caution  as  not  to 
exceed  the  maximum  internal  temperature  of  55  degrees  C  during  testing.  Once  the  RTD 
mounted  in  the  RSS  has  reached  55  degrees  C,  perform  the  test  in  accordance  with  Functional 
Test  C.  Turn  power  off  to  the  RSS  and  reduce  the  chamber  to  ambient  air  to  0  degrees  C.  When 
the  chamber  air  passes  through  room  temperature  (23  degrees  C),  this  completes  1  temperature 
cycle.  Repeat  the  above  two  additional  times  to  complete  three  (3)  temperature  cycles.  At  the  end 
of  the  third  cycle,  the  chamber  ambient  air  is  reduced  to  room  temperature  (23  degrees  C).  Once 
the  RTD  has  reached  room  temperature,  turn  power  on  and  perform  the  test  in  accordance  with 
Functional  Test  A.  Once  the  above  has  been  successfully  completed,  increase  the  chamber 
ambient  air  to  greater  than  60  degrees  C  (65  degrees  C).  In  accordance  to  Functional  Test  D, 
monitor  the  RSS  until  the  unit  demonstrates  the  safe  system  shutdown  provision.  Verify  actual 
temperature  of  the  RSS  by  the  temperature  controller  display.  Reduce  chamber  ambient  air  to  23 
degrees  C  and  verify  unit  recovery  temperature.  Turn  off  power  to  the  RSS  and  allow  to  return  to 
room  temperature  (23  degrees  C).  Perform  a  post  ESS  test  in  accordance  with  Functional  Test  A. 
This  concludes  the  RSS  Environmental  Stress  screening  testing. 


RSS  off  app  d  >  60  c 


FIGURE  2  RSS  Environmental  Testing 


3.6.6  Functional  Test  A 

1.  Connect  video  source  to  Camera  1,2,3, 4  of  Remote  Sensor  Subsystem  (RSS)  if 
not  already  done. 

2.  Connect  communication  link  to  RSS  and  to  Central  Control  Subsystem  (CSS)  if 
not  already  done. 

3.  Connect  video  monitor  to  RSS  video  out  if  not  already  done. 

4.  Connect  power  cord  to  1 10  volt  and  to  RSS  via  AC  line  separator  if  not  already 
done. 

5.  If  RSS  is  not  already  on  turn  system  on,  measure  and  record  AC  current. 
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6.  Verify  power  indicator  and  status  indicator  are  illuminated  and  remain  illuminated 
after  2  minutes. 

7.  From  the  CSS  request  a  B/W  snapshot,  Color  snapshot  and  Health  from  camera  1. 
Log  health  information. 

8.  Repeat  snapshots  for  remaining  cameras. 

3.6.7  Functional  Test  B  (with  low  temperature  heater  operation) 

1 .  Turn  AC  power  on. 

2.  Monitor  AC  current. 

3.  On  first  cycle  current  should  increase  by  approximately  .5  amps  when  system 
turns  on.  On  remaining  cycles  system  should  come  on  immediately. 

4.  Measure  and  record  AC  current. 

5.  Verify  power  indicator  and  status  indicator  are  illuminated. 

6.  From  the  CSS  request  a  B/W  snapshot,  Color  snapshot  and  Health  from  camera  1. 
Record  health  information. 

7.  Repeat  snapshots  for  remaining  cameras. 

3.6.8  Functional  Test  C  (at  high  temperature) 

1 .  Measure  and  record  AC  current. 

2.  Verify  power  indicator  and  status  indicator  are  illuminated. 

3.  From  the  CSS  request  a  B/W  snapshot.  Color  snapshot  and  Health  from  camera  1. 
Log  health  information. 

4.  Repeat  snapshots  for  remaining  cameras. 

3.6.9  F unctional  T est  D  (at  safe  shutdown  temperature) 

1 .  Increase  Chamber  temperature  until  AC  current  drops  to  zero.  Record  the  turn  off 
chamber  temperature.  Caution,  do  not  allow  ambient  to  exceed  65  degrees  C. 

2.  Decrease  ambient  temperature  while  monitoring  AC  current.  Continue  to  reduce 
chamber  temperature  until  current  returns  to  approximately  .5  amps. 

3 .  Record  the  turn  on  chamber  temperature. 

4.  Measure  and  record  AC  current. 

5.  Verify  power  indicator  and  status  indicator  are  illuminated. 

6.  From  the  CSS  request  a  B/W  snapshot,  Color  snapshot  and  Health  from  camera  1. 
Log  health  information. 

7.  Repeat  snapshots  for  remaining  cameras. 
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4.0  Information  gained  /  Lessons  learned  /  Results 

4.1  Approach.  TFVC  proved  to  be  an  innovative  approach  to  a  difficult  problem.  It 
provided  cost-effective  real-time  traffic  flow  data  and  achieved  promising  results  to  a  variety  of 
tough  technical  problems. 

4.2  Integration.  System  integration  is  a  key  element  in  the  development  of  a  system  such  as 
TFVC.  Systems  such  as  these  need  to  be  tested  in  a  modular  fashion.  In  particular,  the  network 
subsystem  must  be  fully  tested  before  the  rest  is  deployed.  Network  problems  comprised  the 
great  majority  of  fielding  difficulties. 

4.3  Fielding.  Fielding  a  system  such  as  this  at  an  urban  site  requires  the  support  of  local 
agencies  and  contractors.  TFVC  had  very  good  support  from  NYSDOT  and  their  contractors 
Johnson  Electric  and  Wiley  Engineering.  These  costs  grew  over  time,  however,  and  future  efforts 
need  to  take  this  into  account  and  budget  accordingly. 

4.4  Iris  Control.  Iris  control  is  a  critical  element  in  camera  based  surveillance  systems.  It  is 
a  key  to  providing  adequate  contrast  for  traffic  flow  speed  algorithms  to  be  effective.  The  TFVC 
approach  to  iris  control  was  creative  and  innovative,  but  complicated.  This  needs  be  an  area  of 
further  work  and  development,  particularly  taking  into  account  weather  related  effects.  A  more 
robust  iris  control  algorithm  needs  to  be  developed  and  tested.  Our  experience  teaches  us  that 
this  important  issue  (for  all  video  based  traffic  detection  systems)  that  should  be  carefully 
addressed. 

4.5  Software  Methods.  Object  oriented  software  methods  provide  efficient  ways  to  develop 
and  test  the  software  used  on  this  project.  Microsoft  Visual  C++  is  an  excellent  development 
platform.  The  extended  DOS  environment  used  on  the  sensor  worked  well,  but  had  some 
limitations.  Using  Windows  NT  for  the  sensor  operating  system  would  be  the  next  logical  step. 

4.6  Network.  Network  issues  proved  to  be  the  most  difficult  in  the  implementation  of  the 
TFVC  system.  The  ISDN  and  the  wireless  system  experiences  will  now  be  discussed  in  detail. 

4.6. 1  ISDN  Implementation  within  the  TFVC  system.  During  the  FASTRACK  phase 
of  the  TFVC  program  the  use  of  ISDN  (Integrated  Services  Digital  Network)  as  a  high 
bandwidth  communications  channel  was  evaluated  on  4  of  the  original  5  sites.  It  was  also 
originally  planned  to  be  used  as  the  primary  communications  channel  for  the  six  eastern  most 
sites  that  had  no  access  to  the  INFORM  cable  trunk.  These  sites  were  subsequently  outfitted  with 
a  wireless  LAN  system,  but  the  ISDN  access  was  installed  as  a  backup.  One  Primary  Rate 
Interface  (PRI)  line  was  installed  at  the  INFORM  control  center  at  the  state  building  in 
Hauppauge  N.Y.  One  full  Basic  Rate  Interface  (BRI)  line  was  installed  at  each  of  the  four 
selected  sites.  A  full  BRI  is  made  up  of  2  data  channels  @  64kbps.  A  Gandalf  network  bridge 
with  PRI  interface  was  used  as  the  ISDN  concentrator  in  the  INFORM  control  center.  Combinet 
ISA  based  adapter  cards  were  used  in  the  sensor  hardware  to  interface  to  the  ISDN  lines.  These 
adapters  appeared  as  network  interface  cards  to  the  sensor  operating  system.  The  INFORM 
maintenance  contractor  performed  TFVC  cabinet  wiring  of  the  ISDN  interface.  Bell 
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Atlanti c/NYNEX  performed  all  the  provisioning  of  the  ISDN  lines  as  well  as  the  installation  of 
the  PRI  line  in  the  INFORM  control  center. 

The  PRI  line  required  quite  a  lot  of  time  to  be  installed  by  NYNEX,  resulting  in  a  delay. 
The  GANDALF  concentrator  went  through  several  software  revisions  before  a  working  revision 
worked.  This  was  a  problem  primarily  with  compatibility  with  the  multi-link  protocol  and  user 
authentication.  In  addition,  local  Tariffs  of  ISDN  lines  can  make  them  very  expensive  to  use.  The 
dial-on-demand  features  did  not  work  reliably.  TFVC  sensor  software  had  problems  monitoring 
or  acting  on  ISDN  connection  status.  ” 

The  COMBINET  ISDN  adapter  card  appeared  as  a  network  interface  card  to  the 
operating  system  which  meant  no  special  software  was  needed  for  the  network  connections.  This 
card  also  had  a  back  door  via  a  terminal  program  that  allowed  for  monitoring  the  connection 
status.  NYNEX  provisioned  the  site  ISDN  BRI  lines  quickly,  and  they  worked  immediately.  The 
PRI  line,  once  it  was  installed,  worked  right  away.  When  we  had  a  connection  from  the  GUI  to 
the  sensor,  the  extra  bandwidth  really  improved  the  video  response.  This  was  especially  helpful 
during  Pan/Tilt  operations. 

Once  the  GANDALF  concentrator  was  working,  the  ability  to  link  the  two  “B”  channels 
to  get  128  kbps  of  raw  data  speed  proved  invaluable.  Due  to  software  and  protocol  overhead  our 
actual  data  rates  were  around  100  kps.  This  was  far  better  than  the  28.8  kbps  raw  data  speed  of 
the  POTS  lines.  ISDN  lines  can  establish  a  connection  on  the  order  of  hundreds  of  milliseconds 
while  POTS  lines  take  around  30  to  50  seconds. 

4.6.2  Wireless  Ethernet.  Wireless  communication  products  were  purchased  from  TTI 
Wireless.  The  processor/transmitters  (bridges)  are  designed  to  work  up  to  5  miles,  or  up  to  30 
miles  with  optional  amplifiers.  The  antennas  require  very  high  clearance  over  the  ground  for  this 
distance.  The  bridges  that  were  obtained  operate  in  the  2.4  GHz  frequency  range  using  a  spread 
spectrum  technique.  The  2.4  GHz  range  was  selected  over  the  other  915  MHz  range  because  of 
interfering  competition  from  wireless  phones  and  other  systems  within  the  915  MHz  range. 

Alignment  of  the  antennas  using  the  software  utility  PTPDIAG  as  noted  by  the 
manufacturer  is  critical  to  a  proper  functioning  system.  When  two  antennas  were  required  at  a 
site  they  were  offset  by  4  to  5  feet  and  cross  polarized  for  adjacent  sections.  This  setup  of 
antennas  is  explained  in  the  Sensor  hardware  manual  and  is  done  to  reduce  signal  effects  of  two 
antennas  placed  back  to  back.  A  wireless  section  consists  of  two  bridges  with  two  antennas 
beaming  signals  between  them.  These  bridge  pairs  must  also  have  the  same  Network  ID 

(NWID).  The  NWID  is  alternated  to  reduce  the  effects  of  cross  talk  between  non-adjacent 
antennas. 

Although  several  sites  had  Poor  or  Acceptable  Link  Quality  Assessment  it  did  not  seem 
to  affect  the  effective  bandwidth  of  that  or  neighboring  sites.  Sites  should  be  tested  using  a 
sensor  link  from  the  remote  GUI,  or  two  computers  one  being  an  FTP  server  and  the  other 
computer  requesting  a  large  data  file.  Obstacles  like  highway  signs  in  the  line  of  sight  greatly 
affect  effective  bandwidth  even  if  the  Link  Quality  Assessment  is  Good.  The  AC  power  plugs  to 
the  bridges  and  the  connectors  from  each  antenna  were  of  a  push-on  type  that  could  come  easily 
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loose.  Usually  the  bridge  was  mounted  with  that  end  down.  Cable  ties  were  used  to  keep  these 
connections  in  place.  In  order  to  run  diagnostics  on  a  bridge  node  a  keyboard  and  monitor  must 
be  carried  to  each  site.  Two  bridges  at  adjacent  sensor  sites  must  be  set  m  the  diagnostic  mode. 
Once  the  proper  diagnostic  mode  is  started  the  keyboard  and  monitor  can  be  removed  and  used  at 
an  adjacent  site  to  monitor  all  functions  or  make  antenna  adjustments.  These  diagnostic  modes 
will  continue  indefinitely  as  long  as  power  is  not  interrupted.  When  testing  is  completed  bpfh 
bridges  must  be  rebooted  for  proper  operation  to  automatically  resume.  The  power  plug  must  be 
removed  to  interrupt  power.  There  is  no  need  to  have  the  keyboard  and  monitor  attached  to 
return  the  bridges  to  normal  operation.  For  the  most  part  the  sites  east  of  Hawkins  were 
staggered  from  east  to  westbound  sides  of  the  LIE.  This  proved  to  be  very  effective  in  cutting 
down  on  obstruction  problems  especially  along  the  sides  of  the  road.  The  antennas  used  were  o 
a  lightweight  aluminum  in  an  open  “bird  cage”  design  with  very  low  wind  shear.  This  open 
design  is  also  valuable  in  decreasing  snow  and  ice  buildup.  We  used  the  same  pole  bracket, 
horizontal  arm,  and  360-degree  tilt  bracket  from  Pelco  that  are  used  on  fixed  cameras. 

There  is  a  pretty  steep  learning  curve  on  learning  these  systems  and  setting  them  up  in  a 
lab  environment  is  a  must.  The  test  system  should  include  two  antennas  facing  away  from  each 
other  to  reduce  high  gain  problems.  Each  bridge  must  be  individually  checked  and  configured,  as 
the  overall  system  requires.  Note  that  for  sites  requiring  two  antennas  that  there  are  two 
associated  cards  in  each  bridge  that  must  be  configured. 

Once  the  bridges  are  set  up  in  the  lab,  the  installation  is  straightforward.  Assembling  the 
antennas,  which  come  in  two  pieces,  is  a  simple  five-minute  operation  that  should  be  done  on  the 
ground  at  the  site.  Installation  of  the  antenna(s)  by  electricians  is  a  simple  matter  from  a  bucket 
truck  The  antenna  cable  can  be  installed  at  the  same  time  if  desired,  but  was  usually  Pr®ins^  f 
by  Johnson  Electric  (NYSDOT  Electrical  Contractor)  to  save  time.  The  antenna  should  be 
“eyeballed”  to  the  nearest  associated  antenna.  The  bridges  are  easily  mounted  to  the  equipment 
rails  in  the  330  enclosure.  ITT  Systems  personnel  usually  mounted  the  bridge  ahead  of  time. 
Once  the  antenna  is  secure  simply  connect  the  antenna  cable(s),  connect  a  lOBaseT  cable  to  the 
sensor  and  power  on  the  unit.  The  final  alignment  can  be  done  between  any  two  fully 
functioning  sites  using  the  PTPDIAG  utility.  It  usually  takes  just  a  few  minutes  to  find  the 

optimum  direction. 

These  units  have  required  no  service  once  they  were  configured  and  installed.  The  units 
perform  completely  to  their  specifications.  The  total  cost  for  the  wireless  hardware  came  to 
almost  $31  000.  For  the  6  additional  sites  that  is  $5,166  per  site.  Although  this  is  a  high  initial 
cost  there  are  no  monthly  charges  as  in  leased  lines  at  56K  and  ISDN.  The  cost  effectiveness  is 
quite  low  when  compared  with  installing  brand  new  coax  or  fiber  optic  cable  to  these  sites. 

4  6  3  The  RF  Cable  Modem  implementation  within  the  TFVC  system  includes  nine  of 
the  TFVC  sites  use  the  existing  INFORM  RF  cable  backbone  infrastructure  to  send  and  receive 
data  to  the  TFVC  GUI  and  SQL  server  computers  in  the  INFORM  control  center  The  site  at 
Hawkins  Ave.  (#36)  also  acts  as  a  collection  point  for  the  six  wireless  Ethernet  LAN  sites  east  of 
Site  #36.  This  was  chosen  over  other  solutions  to  support  high  data  rates  between  the  TF 
sensors  and  the  GUI  computers.  Also,  the  equipment  was  purchased  as  capital  items  with  no 
recurring  charges  for  leased  lines  that  would  come  out  of  an  operational  budget. 


14 


Cable  Modem  System  Components: 

•  1  3COM  NetBuilder  2  Router  with  4  HSS  ports  to  support  9  cable  modem  sites. 

•  9  3COM  NetBuilder  22 1  Routers  for  each  of  the  TFVC  sensor  sites. 

•  16  RF  Networks  5450  Cable  Modems  @  256K  data  rate 

•  2  RF  Networks  5450  Cable  Modems  @  1544K  data  rate 

•  18  V.35  cables  to  go  between  the  router  and  cable  modem.  One  each  per  pair. 

•  2  TONER  TDA-1 12  1GHz.  Broadband  Drop  Amplifier 

•  2  TONER  XGVS-16  1GHz  16  Way  Splitter 

•  10  BLONDER  TONGUE  DSV  Multiplexers 

•  RG59U  cable  with  F-connector 


FIGURE  3  Cable  System  Block  Diagram 

There  were  difficulties  encountered  with  the  Cable  system.  The  original  frequency 
allocations  for  these  RF  cable  modems  only  allowed  for  one  outbound  channel  to  be  shared  by 
all  cable  sites.  The  routers  require  that  each  site  have  its  own  channel  for  both  inbound  and 
outbound  data.  The  INFORM  cable  did  not  have  enough  spare  bandwidth  available  in  the  lower 
frequency  band  (5MHz  -  30MHz).  So  channels  were  reallocated  for  1  1544KB  channel  each  way 
and  8  channels  that  could  support  256K  data  rates  each  way. 


15 


Sixteen  of  the  modems  were  sent  back  to  RF  Networks  to  have  a  data  rate  change  from 
1544Kbps  to  256Kbps.  This  was  attempted  in  the  field,  as  the  vendor  (RF  Networks)  indicated  to 
us  that  this  is  possible.  However,  specialized  test  equipment  was  required.  Also,  this  was  a  new 
revision  of  their  data  rate  kit,  and  installation  procedures  were  not  available.  All  of  this  resulted 
in  considerable  time  delays. 

The  cable  modems  are  actually  designed  to  use  a  separate  cable  for  inbound  and 
outbound  channels.  Even  with  the  inclusion  of  a  splitter  there  was  a  lot  of  output  power  feeding 
back  into  the  receiver  and  causing  problems.  We  solved  this  with  the  inclusion  of  the  DSV 
Multiplexer,  which  has  very  little  insertion  loss  but  a  lot  of  isolation  between  the  inbound  and 
outbound  frequency  range.  Each  sensor  site  got  one  of  these.  Plus  one  was  needed  in  the 
INFORM  control  center. 

The  receiver  in  the  cable  modem  has  a  narrow  AGC  range.  With  all  of  the  different  taps, 
splitters,  etc.  on  the  system  at  each  sensor  site,  keeping  the  input  power  within  this  range  was 
difficult. 

The  NBII  had  a  problem  for  awhile  that  kept  it  from  doing  its  bridging  function.  With 
3COM  technical  supports  help,  it  was  finally  determined  that  the  files  on  the  FLASH  boot  drive 
was  corrupted.  Once  this  was  fixed  the  NBII  worked  fine. 

The  RF  Networks  cable  modems  rely  solely  on  their  modulation  scheme  for  bit  error  rate 
reduction.  The  NBII/NB221  routers  only  do  error  detection  on  the  incoming  packets.  These  two 
combined  don’t  pose  a  problem  as  long  as  the  transmission  medium  is  relatively  error  free.  This 
was  not  the  case.  The  routers  will  drop  a  connection  when  they  detect  too  many  errors.  They  will 
try  to  reestablish  the  link  but  most  often  this  would  fail.  Therefore  operator  intervention  was 
required  to  bring  the  link  back  up.  This  happened  with  a  very  high  frequency.  A  cable  modem 
that  utilized  an  error  correction  scheme  on  the  bit  stream  would  have  been  helpful. 

The  INFORM  maintenance  contractors  started  doing  a  major  tune-up  of  the  cable  trunk 
during  TFVC  fielding.  This  caused  a  lot  of  variability  in  the  signals  on  the  cable  trunk  and  made 
debugging  our  problems  all  the  more  difficult. 

Sections  of  the  LEE  where  our  sensors  reside  were  undergoing  a  major  road  upgrade.  This 
resulted  in  the  cable  trunk  or  electrical  power  being  interrupted.  This  also  caused  time  delays. 

When  a  good  connection  was  established,  the  live  video  worked  very  well.  We  didn’t 
really  see  much  difference  in  frame  rate  from  the  1544Kbps  site  vs.  a  256Kbps  site.  This 
probably  indicates  that  we  are  processor  limited  (to  some  extent)  on  the  GUI  and  SENSOR  ends. 

4.7  Software  Maintenance  and  Upgrade  Issues 

4.7. 1  TFVC  GUI  systems  run  on  top  of  Windows  NT  3.5 1  as  the  base  operating  system. 
Microsoft  has  stopped  support  of  this  revision  of  NT.  We  have  tested  the  GUI  code  under  NT  4.0 
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and  know  of  no  compatibility  issues.  Microsoft  has  not  finished  Y2K  compliance  testing  as  of 
August  1998.  MS  Office  Pro  4.3,  the  suite  that  was  used  with  the  system  has  numerous  Y2K 
issues,  particularly  with  Access  2.0. 

4.7.2  TFVC  SERVER  systems  utilize  Windows  NT  3.51  Advanced  Server  as  the  base 
operating  system.  Microsoft  has  stopped  support  of  this  revision  of  NT.  Microsoft  has  not 
finished  Y2K  compliance  testing  as  of  August  1998. 

4.7.3  TFVC  Database  Server  is  SQL  Server  6.0  and  is  not  scheduled  to  be  Y2K 
compliance  tested,  but  SQL  server  6.5  is.  We  bought  SQL  6.5  for  TFVC  but  never  installed  it  on 
the  delivered  server.  We  would  need  to  test  our  database  connectivity  with  SQL  6.5  to  determine 
if  there  are  any  issues. 

4.7.4  TFVC  Sensor  utilizes  MSDOS  6.2  and  Y2K  compliance  results  have  not  been 
released  yet.  We  believe  there  may  be  compliance  issues  with  MSDOS  5.0.  Everything  else 
should  be  O.K.,  but  we  have  not  tested  it  for  Y2K  compliance. 

4.7.5  Development  Environments.  In  general,  all  of  the  TFVC  development  suites  are 
several  revisions  old  and  would  need  to  be  updated  for  further  development.  The  compilers  in 
particular  will  have  Y2K  issues.  This  would  include  the  following: 

GUI  and  DB  codes: 

Microsoft  Visual  C++  4.2 
LeadTools  V9.0 
Matrox  MIL-Lite 
Sensor  code: 

Watcom  C++ 10.5 
PCTCP  Developers  kit. 

Bitflow  Raptor  SDK 

4.8  Fiber  Optics  Development 

4.8.1  Adapting  the  TFVC  system  to  be  used  with  a  fiber  optic  based  network  would  be 
straightforward.  The  details  of  the  network  topology  would  have  to  be  defined  before  an 
approach  could  be  envisioned,  however.  Basically,  TFVC  consists  of  networked  PCs  --  much  as 
any  LAN  or  enterprise  network  would  function.  This  basic  design  feature  allows  for  current 
state-of-the-art  technology  and  off  the  shelf  networking  solutions  to  be  leveraged  efficiently  into 
a  solution.  Particular  issues  that  are  unique  to  the  TFVC  network  development  deal  with 
accessibility  to  sites  and  bridging  between  different  media.  Otherwise,  any  standard  networking 
approach  could  implemented  within  the  TFVC  system  with  minimal  impact  on  the  overall 
architecture. 

4.9  Overall  Cost  /  Performance  Tradeoffs  of  each  Networking  Approach  Used 
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4.9. 1  Based  on  TFVC  development  and  fielding  experience  we  would  rank  the  various 
networking  approaches  that  were  used  in  terms  of  cost  and  performance  as  follows.  The  scale  is 
from  one  to  ten  (ten  being  high  cost  and  high  performance). 


Cost 

Performance  (if  working) 

Telephone  modem  -  POTS 

2 

2 

Telephone  modem  -  ISDN 

8 

5 

RF  cable  modem 

9 

6 

Wireless  Ethernet 

8 

9 

Flow  Speed  Calculation 

Introduction 

For  traffic  monitor  and  control,  one  of  the  most  important  parameters  is  vehicle  speed. 
Currently,  the  loop  sensor  determines  the  vehicle  speed  by  determining  the  vehicle  length  and 
the  time  it  takes  to  pass  the  loop,  which  yields  the  speed.  This  method  is  not  reliable  due  to  the 
noise  and  other  errors  in  determining  the  length  of  the  vehicle.  It  also  requires  an  accurate 
calibration  for  it  to  work  properly.  The  main  problem  comes  from  the  fact  that  it  determines 
vehicle  speed  vehicle  by  vehicle,  which  is  more  susceptible  to  noise  and  other  errors.  Also,  by 
monitoring  only  individual  vehicle,  we  can  not  have  a  good  picture  of  the  overall  traffic 
condition,  and  thus,  will  not  be  able  to  react  fast  enough  to  a  sudden  traffic  condition  change.  In 
order  to  alleviate  the  noise  factor  and  be  able  to  monitor  the  overall  traffic  condition,  we  need  to 
have  a  method  which  treats  the  overall  traffic  as  a  whole  and  determines  its  condition.  With  this 
type  of  method,  most  of  the  individual  noise  and  other  errors  will  be  suppressed  and  it  can  see 
the  correlation  between  the  traffic  conditions  within  a  large  region. 

In  this  article,  we  will  describe  such  a  method.  The  method  uses  correlation  algorithm  to 
determine  the  overall  traffic  speed  in  the  region  of  interest  (ROI).  We  will  call  this  algorithm 
Correlation  for  Flow  Speed  (CFS)  algorithm.  This  algorithm  comprises  two  parts:  the  collapsed 
waveform  and  the  correlation.  The  collapsed  waveform  method  collapses  a  2-D  image  of  the 
lane(s)  into  a  1-D  waveform  along  a  certain  direction  (Currently  it  is  horizontal  direction  unless 
the  lanes  are  horizontal.  In  that  case,  it  will  be  vertical.  In  the  later  development,  we  will  use 
horizontal  when  the  lanes  are  less  than  45°  from  the  vertical  direction  and  vertical  when  the  lanes 
are  more  than  45°  from  vertical  direction)  by  averaging  the  pixel  intensities  along  that  direction. 
The  collapsed  waveform  will  carry  most  of  the  important  features  of  the  2-D  image.  It  will 
demonstrate  a  peak  (or  valley,  depends  on  the  color  of  the  vehicle)  wherever  there  is  a  vehicle 
and  the  length  of  the  vehicle.  The  only  information  that  it  will  lose  is  its  width  and  its  shape. 
Nonetheless,  this  loss  of  information  will  not  affect  the  accuracy  of  our  flow  speed  computation. 

In  the  following,  we  will  call  the  camera  focal  plane  as  the  image  plane  and  the  roadway 
system  as  the  object  plane. 
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5.2  Collapsed  Waveform  Algorithm 

In  this  section,  we  will  discuss  the  collapsed  waveform  algorithm.  In  all  the  formulas  in 
this  section,  we  will  use  Px  and  Py  as  coordinates  in  the  image  plane.  Bear  in 


(0,0) 


mind  that  Px  and  Py  are  discrete,  that  is,  they  only  increment  by  integral  values  since  we  have 
only  discrete  pixel  mesh. 

Assume  we  have  a  2-D  traffic  image  with  a  lane  (For  multiple  lanes,  the  conclusion  will 
be  the  same  since  we  collapse  only  one  physical  lane  or  one  super-lane  comprised  of  multiple 
lanes),  as  shown  in  FIGURE  4.  Lx  and  L2  are  the  left  and  right  curves  of  the  lane.  Assume  that 

the  equations  for  the  two  curves  are  order  2  parabolic  functions  (this  is  a  valid  assumption  in  that 
the  traffic  lane  curves  are  generally  less  than  or  equal  to  order  2  within  a  small  region  in  which 
we  are  interested.  The  derivation  below,  however,  will  be  still  valid  for  higher  order  polynomial 
functions): 
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and 


(II.  la) 


L,:  PJPy)  =  alPy2  +blPy  +  cl 

Lp.  Pxl(Py)  =  a1Py2+b1Py+c1  (II.lb) 

The  ROI  starts  from  Yx  to  Y2 .  Assume  that  there  are  N  vehicles,  Vi ,  with  bottom  and  top  Py 
coordinates  PyiX  and  Pyj2 ,  <  Pyn  <  Pyi2  ^  Y2 ,  0  <i<N,  in  the  ROI,  and  that  the 

intensities  for  the  vehicles  are  uniform  with  value  1  and  the  background  intensity  is  0.  Let 
f(Px,Py )  be  the  intensity  function  of  the  2-D  image.  Thus, 


f(PX,Py)  =  \ 


(Px,Py)  on  or  inside  a  vehicle 
( Px,Py )  outside  a  vehicle 


Pxl(P)<Px<Px2(Py)  and  Yx<Py<Y2 


(11*2) 


We  then  collapse  the  traffic  lane  f(Px,Py)  into  1-D  waveform  g(Py)  by  averaging  over  the 
traffic  lane  horizontally  (or  along  the  x  direction)  to  give 


g(Py) 


1 


PAP,)-PAPy)  +  lF.-W,) 


r,2(Py) 


N- 1 


g(Py)  =  IMPy  -Pyn)~  «(Py  ~  Py, 2)1 


i=0 


Yx<Py<Y2 


where  u(Py  )  is  a  step  function 


u(Py)  = 


Py>  0 
Py<  0 


(11*3) 


(II.4) 


g(Py  )  is  as  shown  in  FIGURE  5. 

In  the  above,  we  assume,  for  simplicity,  that  the  vehicles  fill  up  the  whole  traffic  lane  to  still 
yield  average  intensity  1  (Normally  that  is  not  the  case.  However,  a  vehicle  generally  occupies 
most  of  a  lane  width,  so  the  average  intensity  will  be  slightly  below  1.  Thus,  it  is  a  valid 
assumption). 
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The  collapsed  waveform  algorithm  basically  reduces  the  complexity  of  a  2-D  image  into 
a  1-D  waveform  while  maintains  important  information.  This  is  significant  since  it  generate  the 
same  results  with  less  computational  power,  which  saves  cost  and  time  of  a  development  cycle. 


g(Py) 


FIGURE  5  1-D  Collapsed  Waveform  g(Py )  of  a  Traffic  Lane 

Now  that  we  have  the  collapsed  waveform,  we  can  process  it  to  generate  useful  results 
such  as  the  flow  speed.  In  the  following,  we  will  discuss  the  correlation  algorithm  for  flow  speed 
determination. 

5.3  Correlation  Algorithm  for  Flow  Speed  Computation 

Because  we  will  deal  with  1-D  collapsed  waveform  in  this  section,  we  will  drop  the 
subscript  y  in  Py  in  the  above  collapsed  waveform  for  simplicity.  Thus,  Eq.(II.3)  becomes: 


g(P)=YX<P-P^)-«(P-Pn)\ 

f= 0 

y1<p<y2  (in.i) 

and  FIGURE  5  becomes  FIGURE  6. 

We  will  use  y  coodinate  for  the  object  plane  to  distinguish  the  coordinates  between  the 
image  plane  and  the  object  plane. 

In  order  to  demonstrate  the  idea  of  using  correlation  algorithm  to  determine  flow  speed, 
we  will  ignore  in  subsection  A  the  camera  perspective,  that  is,  we  will  assume  that  the  calibration 
factor  for  the  whole  y  direction  is  the  same.  The  effect  of  camera  perspective  on  the  flow  speed 
computation  using  correlation  algorithm  will  be  discussed  in  subsection  B. 
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FIGURE  6  Redraw  of  1-D  Collapsed  Waveform  g(P)  of  a  Traffic  Lane 

A.  Uniform  Calibration  Factor  for  the  Whole  y  Direction 

Assume  that  all  the  vehicles  move  in  the  same  speed,  v .  At  dt  time  interval,  the  vehicles 
will  move  by  dy  distance  in  the  object  plane 

dy  =  vdt  (HLA.1) 

With  no  perspective,  the  calibration  factor  will  be  same  for  the  whole  y  direction.  Assume  this 
constant  calibration  factor  is  y .  Then  the  pixel  shift  in  the  image  plane  will  be  dP 


vdt 

r 


Thus,  g(P)  becomes  G{P), 


(III.A.2) 
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Eq.(III.l) 


»  G{P)  =  g(P-dP) 


(III.A.3b) 


y1<p<y2 


For  Eqs.(III.  A.3a)  and  (III.  A.3b)  to  be  true,  we  have  assumed  that  no  vehicle  has  moved  into  or 
out  of  the  ROI  region,  as  shown  in  FIGURE  7.  That  is. 


and 

or 

and 


g(P )  =  0 

for  Yl-dP<P<Yl 

(III.A.4a) 

g(P) = 0 

for  Y2-  dP  <  P  <Y2 

(III.A.4b) 

G(P)  =  0 

for  Yx<  P  <YX+  dP 

(III.  A.  4c) 

G(P)  =  0 

for  Y2<P<Y2+dP 

(III.A.4d) 

In  reality,  this  is  not  true.  However,  as  long  as  dP  «  Y2  —  Fj ,  the  result  will  be  similar  for  the 
real  case. 


FIGURE  7  1-D  Collapsed  Waveform  G(P)  =  g(P  -  dP )  of  a  Traffic  Lane 

From  Eq.(III.A.3b),  we  see  that  G(P)  is  a  shifted  version  of  g(P),  as  expected.  Now 
we  want  to  compute  the  auto-correlation  function  rgg  ( P)  of  g(P)  and  cross-correlation 
function  rGg( P)  of  G(P)  and  g(P) .  As  defined, 

rss(P)= 

P\=Y{ 

-(Y2-Yi)<P<(Y2-Yl)  (IH.A.5a) 
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and 


rGg(P)  =  f,G(Pl)g(Pl-P) 

P\=YX 

=  Yug(p\-dp)g{p\-p ) 

PUYX 


-{Y2-Y{)<P  <{¥,-¥,)  (III.  A.  5b) 

We  have  dropped  the  complex  conjugate  on  the  second  g  function  on  the  right-hand  side  of  both 
Eqs.(III.  A.5a)  and  (III.A.5b)  since  we  deal  with  real  functions  here.  The  limits  on  P  are  derived 
on  the  fact  that  function  g(Pl)  is  only  defined  in  the  range  [Y{,Y2]. 

Substitute  P\  —  dP  by  PI  in  Eq. (III.  A. 5b),  we  have 

Y2-dP 

'•Cgw=  'Zg(p\)g(p\+dp-p) 

P\=Yx-dP 


Eq.(III.A.4a,b) 


Pl=Y{ 


rag(P)  =  rgg(P-dP) 


(III.A.6) 


We  see  that  rGg(P)  is  a  shifted  version  of  r  (P)  ■  Now  we  will  prove  that  rgg ( P)  achieves 
maximum  at  P  =  0 ,  thus  rGg  (P)  at  P  =  dP ,  according  to  Eq.(III.A.6).  For  that  purpose,  we 
set  up  the  following  inequality 

f>g(/>l)  +  iT(Pl-P)]2£0  (III.A.7a) 

PUY{ 

=>  cP  ig2(/>l)  +  2 a  £g(Pl)g(/>l -  P)  +  £g2(Pl -  P) > 0 

pi=y,  pi=yx  pi=yx 

=>  a2rgg  (0)  +  2  argg  ( P)  +  rgg  (0)  >  0 
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We  view  the  above  inequality  as  a  quadratic  function  of  a.  Because  it  is  nonnegative,  its 
discriminant  has  to  be  nonpositive.  Thus, 

or 

|rss(P)|<|rss(0)|=/i?(0)  (III.A.7b) 

The  last  equality  comes  from  the  fact  that 

rffl(0)  =  2g2(Pl)>0  (1II.A.7C) 

P1=F! 

Thus  we  see  from  Eq.(III.9b)  that  rgg(P)  achieves  maximum  at  P  =  0.  Thus,  from 

Eq.(III.A.6),  fGg{P)  achieves  its  maximum  at  P  =  dP .  Thus,  by  determining  the  peak  position 

of  the  cross-correlation  function  of  two  waveforms  obtained  from  two  video  frames,  we  can 
determine  the  pixel  shift  dP .  Thus,  from  Eq.(III.  A.2)  we  can  get  the  flow  speed  since  we  know 
the  calibration  factor  and  the  time  between  the  two  correlated  frames.  To  better  illustrate  the 
above  concept,  we  show  the  waveform  and  correlation  function  for  only  one  car  in  FIGURE  8 
(a) -(d). 


B.  Effect  of  Camera  Perspective  on  the  Flow  Speed  Computation 

In  Subsection  A,  we  demonstrate  the  idea  of  correlation  algorithm  for  flow  speed 
computation  with  a  uniform  calibration  factor  along  the  y  direction.  For  a  realistic  situation,  the 
camera  perspective  will  cause  the  calibration  factor  to  vary  along  the  y  direction.  Thus,  we  need 
to  derive  a  formula  for  this  case. 

For  the  same  distance  dy  in  Eq.(III.A.l)  in  the  object  plane,  the  corresponding  pixel  shifts 
in  the  image  plane  will  be  different  for  the  vehicles  in  different  pixel  positions.  Assume  that  all 
vehicles  have  the  same  length,  L.  Thus, 

Pi2  =  Pn+—  0  <i<N  (III.B.la) 

Yn 

Also  assume  that  the  calibration  factors  for  the  top  and  bottom  edges  of  the  ith  vehicle  are  ya 
and  yi2  and  the  corresponding  pixel  shifts  are  dPn  and  dPi2 ,  respectively.  Thus, 

dP  =  — =  —  0  <  i  <  N  and  j  =  1,2  (III.B.  lb) 

^  rv 
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FIGURE  8  (d)  Cross-Correlation  of  the  Waveforms  in  (a)  and  (b) 

The  pixel  positions  and  pixel  shifts  observe  the  following  inequalities: 

Pa<Pi2<Pn<Pj2  0  <i<j<N  (III.B.2a) 

and 
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dPn  <  dPi2  <  dPj]  <  dPj2  0  <  i  <  j  <  N 


(III.B.2b) 


as  shown  in  FIGURE  9. 

For  simplicity,  we  will  assume  that  the  pixel  shifts  are  so  small  and  the  distances  between 
vehicles  are  so  large  that 


Pn  +  dPn  <Pj 2  +  dPol 

0  <i<N 

(III.B.2c) 

Pn  +  dPN_  12  ^Pn+  dPi2 

0<i<N 

(III.B.2d) 

Pj2  +  dPi2  <  PjX 

0<i<j<N 

(III.B.2e) 

Pi2  +  dPN_  12  ^  Pji  +  dPjX 

0<i<  j  <N 

(III.B.2f) 

Eq.(III.B.2c)  describes  that  the  pixel  shift  is  so  small  that  the  shifted  bottom  edge  of  a  vehicle  in 
the  current  frame  will  not  pass  the  top  edge  of  the  same  vehicle  with  the  smallest  shift,  dPQl. 
Eq.(III.B.2d)  shows  that  the  bottom  edge  of  a  vehicle  shifted  with  the  largest  pixel  shift, 
dPN_ j  2 ,  can  not  exceed  its  shifted  top  edge.  Eq.(III.B.2e)  says  that  the  distance  between  two 

vehicles  is  so  large  that  the  shifted  top  edge  of  a  vehicle  in  the  current  frame  can  not  exceed  the 
bottom  edge  of  the  vehicle  in  front  of  it  in  the  previous  frame,  while  Eq.(HI.B.2f)  depicts  that 
even  with  the  largest  pixel  shift,  dPN_l2 ,  the  top  edge  of  any  vehicle  can  not  pass  the  shifted 
bottom  edge  of  the  vehicle  in  front  of  it  in  the  previous  frame. 

The  inequalities  in  Eqs.(IH.B.2c)-(f)  can  be  combined  into  the  following  two  inequalities 

Pn+mwi(dPn-dP01,dPN_l2-dPi2)<Pi2  0<i<N  (III.B.3a) 
and 

Pi2  +  max(<#>2  ,dPN_h  2  -  dPfl)  <  PjX  0  <i<j<N  (III.B.3b) 

With  the  above  assumptions,  Eq.(III.  A.3a)  becomes 

G(P)  =  2>[  P~  Wi  +  dPn)\  -  «[/>  -  (Pl2  +  dPn)]} 

7=0 

=  -pa-dpn)-u(p-pn-  dpa )] 

;= 0 

Yl<P<Y2 


(III.B.4) 


G{P) 


FIGURE  9  The  Shifted  1-D  Waveform  with  Varied  Calibration  Factor 


Note  that  since  the  pixel  shifts  are  different  for  different  pixel  position,  G(P)  is  no  longer  a 
shifted  version  of  g(P).  However,  since  G(P)  is  obtained  from  the  vehicles  shifting  right  in 
g(P) ,  the  correlation  peak  should  still  be  in  the  positive  P  position.  Thus,  we  will  concentrate 

on  P  >  0  region  in  the  following  analysis.  Plug  Eqs.(III.l)  and  (III.B.4)  into  Eq.(III.A.5b),  we 
get 

rGg(P)  =  £  {IK*  -Pa-  dPn )  -  «(*  -  Pl2  -  dPn)}  • 

PUYX  7=0 

IK*  -  Pn  ~  P)  ~  «(*  -Pn~  /”)]> 

7=0 

0<Pz{Y2-Yt) 

or 

r0s(P)=  £  %i(P\-Pn-dPa)u(P\-Pn-P ) 

Pl-YilJ-0 

-u(Pl-Pl2-dPl2)u(Pl-Pn-P) 

-u(P\-Pn-dPa)u(P\-PJ2-P) 

+u(.Pl-Pt2-dPl2)u(Pl-PJ2-P)l 
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0<p<(y2-yj) 


(III.B.5) 


From  the  definition  of  step  function  u(P) ,  we  have 

w(Pl  -  a)u(Pl  -b)  =  w[Pl  -  max(tf,6)]  (III.B.6) 

Thus  Eq.(III.B.5)  becomes 

rGg(p)=  Z  YJ{u[P\-max(Pn+dPn,PJl  +  P)] 

Pl=Y[iJ=0 

-u[Pl  -  max(Pj2  +  dPi2 ,  P;1  +  P )] 

-u[P\  -  max{Pn  +  dPn,PJ2  +  P)] 

+u[P\  -  max(Pj2  +  dPi2,PJ2  +  P)]} 

o<p<(y2-yi)  (iii.b.7) 

Exchange  the  order  of  summations  in  Eq.(III.B.7)  and  move  the  second  summation  into  the 
bracket,  we  have 

rGg{P)=  '£u[Pl-max(Pn+dPn,Pjl  +  P)] 

i  J=0  P\=YX 

-  +dPl2,PJI  +  P)] 

PUYX 

-  £ w[Pl  -  max(^1  +  dPn, PJ2  +  P)] 

Pl=Yi 

+  X  w[Pl  -  max(i>2  +  dPi2 ,  Pj2  +  P)]} 

Pl=Yt 

0<P<(Y2-Yi )  (III.B.8) 

Note 
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and  since 


h 

i 

a 

+ 
H- •* 

Y1<a<Y2 

£u(Pl-a) 

=  i 

-  r, + i 

a  <Y{ 

(III.B.9) 

P\=Y} 

i 

o 

a>Y2 

Yx<Pa<Pi2 

+  dPi2  <  Y2 

0<i  <  N 

(III.B.10) 

=>  ma x(Pik+dPik,PJl  +  P)>Yl  0 <i,j<N  and  k,l  =  1,2 (III.B.ll) 


we  have  from  Eq.(m.B.8) 

rGg(P)  =  E{max[72  “ max(^i  +  dPn,Pn  +  Pm 

i,j= 0 

-max[72  -  max(/>2  +  dPi2,PjX  +  P)>®] 

-max[72  -  max(/’1  +  dPa,Pj2  +  P),0] 

+max[72  - max(Pi2  +  dPi2,PJ2  +  P),0]} 

(III.B.12) 

Divide  summation  over  j  into  three  regions,  j  <  i ,  j  =  i ,  and  j  >  i  as  in  the  following. 

rGg(P)=  ZCZ+Z+ZX™3*^  ~max(Pn  +dPn,PJl  +  P),0] 

i=0  j>i  j=i  j<i 

-max[72  -  max(i?2  +  dPi2,PjX  +  P),0] 

-max[72  -  max(^!  +  dPn,Pj2  +  P), 0] 

+max[72  -  ma x(Pi2  +  dPj2,PJ2  +  P),0]} 

0<  P<(Y2-Yx)  (III.B.13) 

For  the  first  sum  over  j  >i,  due  to  the  assumptions  made  in  Eqs.(III.B.2a)-(f),  we  have  for 

o<p<(i,2-y1). 

pJ2  +  p>pjt  +  p>pl2+dpl2>pn  +dPn 
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Thus, 


0 <P<(Y2-Yx),  0 <i<j<N 


(III.B.14) 


r2  =  XX{max[72  “  max(^i  +  dPa,PjX  +  P), 0] 

i=0j>i 

-max[72  -  max(Pj2  +  dPj2,PJl  +  P), 0] 

-max[7,  -  max(/)!  +dPn,PJ2  +  P),0] 

+max[72  -max(7)2  +dPi2,Pj2  +  70,0]} 

=  ££ {max[72  -  (Pyl  +  70,0]  -max[72  -  {PjX  +  P),0] 

7=0  j>i 

-max[72  -  {Pj2  +  P),0]  +max[72  -  ( PJ2  +  P),0]} 
=  0  0<  P<(}^  -  7j)  (ffl.B.15) 

For  the  second  sum  over  j  =  i ,  it  is  actually  only  one  term,  Let 

r0  m  j  {max[7>  -  max^  +  dPn,Pn  +  P),0] 

7=0 

-max[!^  -  max(7]2  +  dPi2,Pn  +  P), 0] 

-max[72  -ma x(Pn  +dPn,Pi2  +  70,0] 

+max[l^  -max(i}2  +dPj2,Pi2  +  70,0]} 

0<  P<(Y2-Yl)  (III.B.16a) 

And  for  the  third  sum  over  j  <  i ,  Let 

r\  -  “ max(^i  +  dPn,PjX  +  P),0] 

i=0j<i 

-max[72  -  ma x(Pi2  +  dPi2,PjX  +  70,0] 
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-max[y2  -  max(^!  +  dPn,PJ2  +  P),0] 
+max[72  -max(/>2  +dPj2,PJ2  +  P),0]} 


0<  P < (1^  -  7j)  (Hl.B.l6b) 

To  solve  the  Eqs.(III.B.16a)  and  (b),  we  will  assume  that  the  pixel  shifts  are  infinitesimal 
so  that  the  new  waveform  does  not  deform  too  much  from  its  original  shape.  Thus,  the  maximum 
occurs  when  each  vehicle  waveform  tries  to  match  its  own  waveform  in  the  previous  frame,  that 
is,  the  maximum  position  P  satisfies 

dP0l  <P< dPN_ i2 .  (III.B.  17) 


This  means  that  only  the  summation  term  over  j  —  i ,  that  is,  r0,  is  nonzero.  To  show 
that  rx  is  indeed  zero  under  the  condition  in  Eq.(HI.B.14)  and  assumptions  in  Eqs.(III.B.2a)-(f), 
we  use  Eq.(III.B.  16b).  With  assumptions  in  Eqs.(III.B.2a)-(f)  and  Eq.(III.B.  17),  we  have 


Pa+dP,2^Pn  +  dPn-2.  PJ2  +  dPN_t2  +  Pfl  +  P 

dPm  <  PS dPN_12 ,0<j<i<N  (IH.B.18) 

Thus, 

h  =  ESfmaxK -(Pa  +^1)!0]-max[72 -(Pl2  +dPl2),0] 

t=0j<i 

-max[72  -  (Pn  +  dPn),0]  +  max[72  -  (Pi2  +  dPi2),0]} 

=  0  dP0l  <P< dPN_X2  (III.B.  1 9) 

So, 

rGg(P)  =  r0  dPn<,P<,dPN_l2  (III.B.20) 

Also,  with  the  condition  in  Eq.(HI.B.  17),  we  have 

max(4  +  dPik ,  Pjt  +  P)<Y2  (III.B.21) 


Therefore,  Eq.(III.B.16a)  becomes 

ro  =  S'lK  ~ max(^!  +  dPn,Pn  +  P)] 

i=0 
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-[Y2  -  max(/>2  +  dPi2,Pn  +  P)] 

-[Y2  -  ma x(Pn  +  dPn,Pi2  +  P)] 

+[Y2-max(Pi2+dPi2,Pj2  +  P)]} 

=  £[max(/>2  +  dPi2,Pn  +  P)  -  max(^j  +  dPn,Pn  +  P) 

i=0 

+ max(^j  +  dPn  ,Pi2  +  P)  -  max(^2  +  dPi2 ,  Pi2  +  P)] 
dP0l<P<dPN_l2  (III.B.22) 

To  determine  at  which  pixel  position  P  the  maximum  is,  we  divide  [dP0l,  dPN_l  2]  into  regions 

[dPJX,  dPJ2],  0<;<iV,  and  [dPJ2,  dPJ+ll],  0<j<N-\ .The  first  region  is  within 

vehicles  and  the  second  region  is  in  between  two  adjacent  vehicles.  We  want  to  obtain  the 
expression  of  the  cross-coorelation  in  both  type  of  regions. 

First,  assume  that  P  is  in  the  second  region,  thus, 

dPJ2  <:  P < dPJ+lA  0<j<N-\  (III.B.23) 

therefore, 

Pn  +  P  -  pn  +  dPj2  -P{2+  dPn  ^  Pa  +  d^N- 1,2 

a  />,  +  dP;+u  a  Pn  +  P  *  Pn  +  dP)2  a  Pn  +  dPn 

dPJ2  <  P  £  dPJtU ,  0  <;<  j<N-l  (III.B.24a) 
and 

Pl2  +  dPa  >Pn  +  dPJtU  a  pl2  +  P  a  Pn  +  dPn 


So 


>  >  Pn+dP f+l  l  ^  Pn  +  P 

dPj2  <P< dPj+u ,  0 <  j  < i  <  N  (III. B. 24b) 

rGg  (p)  =  (Z+  Z)[max(/>2  +  dPa  ,Pn  +  P)~  ma x(Pn  +  dPn,Pn  +  P) 

/=0  f=y+l 

+max(/?1  +  dPn,Pi2  +  P)  -  max(Pi2  +dPi2,Pi2  +  P)] 
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rGg(P)  =  (i;+E+  +  dPa,Pn  +  P)~  ma x(/>,  +  dPn,Pn  +  P ) 

i=0  1=7  <=7+1 

+max(/>,  +  dPn,Pl2  +  P)-  max(/>2  +dPa,Pa  +  F)] 

=  EK^  +  ^2)  -  (3,  +  P)  +  (^2  +  P)  -  (Pa  +  P)1 
'  +[(PJ2  +  dPj2)  -  ( Pj ,  +  P)  +  (f,2  +  P)  -  (P,2  +  <*P,2>] 

+  iKflj  +  -  (^1  +  <^i)  +  (4  +  P)  ~  (Pa  +  ^2)] 

(=y+i 


2-1 


=  (P,2  -  P71)  +  ZKiJj  +dP, 2)  -  «?■  +  P)1 


7=0 


Thus, 


+  I[(^2  +  />)-«.+^l)] 

*=7+1 

=  eW-^)-[2(^-^2)+  eW.--F)] 

7=0  7=0  7=7+1 


dPjX<P<dPj2  0  <j<N 

f  N- 1  7-1  AT-1 

E(^2-^l)-[E(^-^2)+  IWl  -  P)] 

7=0  7=0  1=7  +  1 


(III.B.28) 


rGg(P) 


dPn  <P<dPJ2fi<  j<N 


E(p>2  -p,0-  l£(P  ~  dPl2 )  +  ZWi  -  P)1 

7=0  7=0  7=7+1 


dPj2<P<dPJ+u,0<j<N-l 


(III.B.29) 


We  will  prove  that  rGg{P)  achieves  maximum  at 

j  =  N/  2-1 


(III.B.30a) 


and 
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P  -  Pmax >  12-1,2  -  ^max  -  ^JV/2,1  (III.B.30b) 

when  N  is  even  and 

j-(N-l)/2  (III.  B.  30c) 

and 

^  =  ^max >  dP(N-l)tl,\  -  Pma x  ~  -1)12,2  (III.B.30d) 

when  N  is  odd.  We  will  prove  the  above  conclusions  in  the  following  steps. 

(i)  N  is  even 


(a)  Prove  that 


VO  0  <  j  <N  /2-\ 

rGg(n-rGg(P)\  =  0  j  =  N/  2-1 

<0  N  /  2-\<  j  <N  -1 

dPj2  <P<P'<  dPJ+ll  0<  j  <N  -1 


(III.B.31) 


that  is,  for  dPj2  <  P  <  dPJ+1  j ,  rG  (P)  increases  as  P  increases  in  the  region  where 
0  <  j  <  N  /  2  -  1 ,  stays  constant  as  P  increases  in  the  region  where  j  —  N  /  2  —  1,  and 
decreases  as  P  increases  in  the  region  N  /  2  —  1  <  j  <  N  —  1 . 


N  even 


rGg(n  -  rGg(P)  =  tZ(P-dP,2)  +  EW  -  P)} 

i= o  i=j+ 1 


[t(P'-dP,i)+  T,(dPn-P')] 

i=0  1=7+1 


(b)  Prove  that 


Z(p-p)-i:(p-p) 

1=7+1  i=0 

[N  -  2{j  +  1)](P'-P) 


>0 

0<  j<N/2- 1 

=  0 

j=N  12-1 

<0 

N/2-l<  j<N- 1 

37 

(III.B.32) 


rGgin-rGg{P) 


>0 

<0 


0<  j<N/ 2-1 
N/2-l<  j  <  N 


dPn  <P<P'< dPJ2  0 <j<N  (III.B.33) 


that  is,  for  dPjY  <  P  <  dPj2 ,  rGg(P)  increases  as  P  increases  in  the  region  where 
0<  j  <  N  /  2  - 1  and  decreases  as  P  increases  in  the  region  N  /  2  — \<  j  <  N . 

rGs(n  -  rGs(P)  =  [£(/>  -  dPa)  +  -  />)] 

7=0  1-j+l 

- \Z(P'-dPl2 )  +  I '(dP„  -  P')l 

7=0  i=j+ 1 

N- 1  /-I 

=  Z(  p'-p)  -  Z(P'-P) 

i=j+l  7=0 

=  [N-2j-l](P'-P) 


N  even 


» 


(c)  Prove  that 


rGg{P) 


>0 

<0 


0<  j<N  / 2-1 
N/2-\<  j  <N 

0<  j<N  !2-\ 

N/ 2-l<  y<  W-l 


(III.B.34) 


<  P < dPJ2 ,  dPJ2  <P'< dPj+ll,  0<j<N-\  (III.B.35) 


that  is,  for  P  increases  from  one  region  [dPjX,dPj2  ]  to  the  next  region  [dPj2  ,dPJ+ll  ]’  rGg(P ) 
increases  where  0  <  j  <  N  /  2  —  1  and  decreases  in  the  region  N  /  2  —  1  <  j  <  N  —  1 . 

zw,  -  />)] 

7=0  7=7+1 


+  zk  -  m 

7=0  7=7+1 
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=  z \p'-p)-i(p'-p)-(p-dpj2) 

1=7+1  i=0 


=  [^  ~  2(y  +  1)](P'-P)  +  (dP f2  -  P) 


Neven,  dPj2-P> 0,  and  dPj2-P'<0 


>o 

<0 


(d)  Prove  that 


0<  j<.NI2-\ 

Nl  2-l<  y<AT-l 


(III.B.36) 


0<  j<N /2-1 
Nl  2-l<  j<N-l 


dPj2  <P<  dPJ+l  l,  dPJ+l  l  <P'<  dPJ+1>2,  0  <  j  <  N  - 1  (III.B.37) 


that  is,  for  P  increases  from  one  region  [  dPj2  ,dPJ+l  \  ]  to  the  next  region  [^+1 1  2  ], 

fGg{P)  increases  where  0  <  j  <  N  /  2-1  and  decreases  in  the  region 
N/2-l<  j<N- 1. 

^(P')  -  ^(P)  =  it CP -  dPa)  +  sWi  -  I3)! 

1=0  i=/+l 

sWi  -  ^’)] 

1=0  i- j+2 

=  ecp'-p)  -  i(P’-p) + (<^,u  -  n 

/=  y+1  /=0 

=  -  2(7  +  1)](P'-P)  +  (rfP,+1>,  -  P') 

jV  even,  dPJ+lx-P>  0  and  dPj+xx-P'<0  j  >  0  j  <N  /  2-1 

*\<0  j>N/2-\ 

Combine  the  above  (a)  to  (d)  proofs,  we  conclude  that  rGg(P) 
j  =  N  /  2  -  1 ,  and  dPN/2_\  2<  P<  dPN/2  x ,  when  N  is  even.  Now  we  prove  the  result  for  N 
odd. 


(III.B.38) 

achieves  its  maximum  at 


(ii)  N  is  odd 
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(a)  Prove  that 


roAH-r^iP) 


dPj2<P<P'<dPJ+ll 


0<  j<(N- 1)/2 
(N- 1)/2<  j  <N  -\ 

o<  y<#  -1 


(III.B.39) 


that  is,  for  dPj2  <  P  <  dPJ+ll ,  rGg(P )  increases  as  P  increases  in  the  region  where 
0<  j  <(N  -V)  /  2  and  decreases  as  P  increases  in  the  region  (N  —  1)  /  2  <  y  <  jV  —  1 . 


-  'bg(^)  =  -^2)  +  I (dPa  ~  P )] 

1=0  1=7+1 


7=0  7=  7+1 

1=7+1  i=0 


=  [W-2(y  +  l)](P'-P) 


.V  odd 


(b)  Prove  that 


=o 


dPj{  <  P<  P'< dPj2 


0<  j<{N-\)!2 
(N -\)/2<j<N 

0<  y<(Af-l)/2 
j  =  {N- 1)/2 
(N- 1)/2<  y<N 

o<  y<Ar 


(III.B.40) 


(in.B.4i) 


that  is,  for  dPJ2  <  P  <dPJ+n,  rGg ( P)  increases  as  P  increases  in  the  region  where 
0<  j <  (N  -  1)  / 2 ,  stays  constant  as  P  increases  in  the  region  where  j  =  (N -  1)  / 2 ,  and 
decreases  as  P  increases  in  the  region  (N  —  Y)  /  2  <  j  <  N  —  \. 


rr,g(P')  -  rGi(P)  =  -  ^2)  +  SW  -  />)] 

1=0  1=7+1 
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N  odd 


(c)  Prove  that 


-&r-dPn)+  zWi-m 

;'=0  /'= 7+1 

AM  7-1 

: 

/=7+l  i=0 

[N-2j-l](P'-P) 

>0  0  <  j  <(N  -1)/ 2 

=  0  j  =  (N- 1)/2 

<0  (N-\)/2<j<N 


(III.B.42) 


rGe(n~rGAP) 


0< y  < (A^ -  1)  / 2 
(A^-l)/2< y  <7V-1 


dPjX  <P< dPJ2 ,  dPj2  <P'<  dPJ+ll ,  0 <  j  <  N  - 1  (III.B.43) 

that  is,  for  P  increases  from  one  region  [dPJX,dPj2  ]  to  the  next  region  [dPj2,dPj+x  j  ].  rGJP) 
increases  where  0  <  j <  (N  —  1)  /  2  and  decreases  in  the  region  (N  —  1)  /  2  <  j  <N  —  1 . 

r^P')  -rGg(P)  =  E(P  -dPn)+  ZWi  -  -?)] 

7=0  7=7  +  1 

-ii(F-dpl2)+Nt(dp«-n] 

i= 0  i=j+l 

=  Z  (P'-P)  -t(p'-p)-(P-  dPJ2) 

i= 7+1  7=0 

=  [W  -  2(7  +  OKP'-i5)  +  (dPJ2  -  P) 


N odd,  dPj2-P> 0,  and  dPj2-P'< 0 


(d)  Prove  that 


rGs{P')~rGs{P ) 


o<  j<(N-\)n 
(N- 1)/2<  J<N-l 

0<  j  <(N  -\)  / 2 
(N- 1)/2< y  <  - 1 


(III.B.44) 
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dPj2  <P<  dPw ,  dPJtll  <  P'<dPj,l2 ,0<j<N-l  (III.B.45) 


that  is,  for  P  increases  from  one  region  [  dPj2 ,  dPj+ ^  ]  to  the  next  region  [ dPJ+l  l ,  dPj+l2  ], 
rGg{P )  increases  where  0  <  j  <  (N  - 1)  /  2  and  decreases  in  the  region 
(N  -Y)/2<  j  <N  -1. 


Nf(dPn  ~  Pfl 


i=j+l 


-[i(p'-dpa)+  Nf(dPa~F)] 

i=Q  i= 7+2 


=  y,(p-p)  -i(P'-n+ ( dp, +u  -  n 

i=j+ 1  »'= 0 


=  IN  -  20'  +  1)](P'-P)  +  (dPJ2U  -  P') 


N odd,  dPJ+l  l-P>0,  and  dP/+u-P'<0 


'>0 

<0 


0<  j<(N- 1)/2 
(N-l)/2<  j<N- 1 


(III.B.46) 


Combine  the  above  (a)  to  (d)  proofs,  we  conclude  that  rGg(P)  achieves  its  maximum  at 

j  =  (N  -  1)  /  2 ,  and  dP(tf_i)/2,i  ^  ^max  -  ^n-i)I2,2  >  when  N  is  odd  Combine  (i)  and  (ii), 

we  conclude  our  proof.  From  the  above  result,  we  can  see  that  the  maximum  of  the  cross¬ 
correlation  is  at  the  median  of  the  pixel  shifts. 

In  the  above,  we  assume  that  the  intensity  for  all  vehicles  are  uniform.  In  reality,  the 
intensities  will  be  different  for  both  the  same  vehicle  and  different  vehicles.  Thus  we  will  most 
probably  not  get  a  range  of  maximum  points.  Typically  it  will  have  only  one  maximum  point. 
This  point  should  be  at 


max 


12-1,2  +  ^V/2,1 

N  even 

2 

dP(N- 1)/2,1  +  dP(N- 1)/2,2 

Nodd 

(III.B.47) 


To  demonstrate  the  idea,  we  show  a  two-vehicle,  N=2,  example.  With  N=2,  j  can  only 
take  0  value,  then,  Eq.(III.B.29)  becomes  (N  even) 
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rGg(P)  =  I  {Pa  ~Pa)~  -  dP<a)  +  Wi  -  />)] 

j=0 

=  't(P,2-Pn)  +  dP<a-dPu 

/= 0 


dP n  —  P  —  dP) [i 


(III.B.48) 


We  see  that  ( P)  is  a  constant.  Thus  it  achieves  maximum  at  dPQ2  ^  P  ^  This  can  be 
seen  in  FIGURE  10  (a)-(c). 


FIGURE  10  (a)  1-D  Collapsed  Waveform  for  Two  Vehicles 
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G(P) 


2  ~ 

1  "  I - I 

i  1 _ L_ 

Poi  +^01  P 32  +  c^02 


_J - 1 - i - .  P 

/ji  +dP\\  Pl2  +dP^2  ^2 


FIGURE  10  (b)  1-D  Shifted  Collapsed  Waveform  for  Two  Vehicles 


5.4  Real  Application 

In  the  above  discussion,  we  correlated  two  waveforms  coming  from  two  frames.  We 
assume  that  the  waveform  has  moved  dP  pixels  from  the  first  frame  to  the  second  frame.  The 
value  of  dP  depends  on  the  distance  between  these  two  frames.  We  will  call  these  two  frames  as 
correlated  frames.  Due  to  the  discrete  nature  of  the  pixel  grid,  the  value  of  dP  will  be  zero  for 
certain  correlated  frames  and  vehicle  speed.  The  bigger  dP  is,  the  higher  resolution,  or  accuracy, 
the  flow  speed  has.  However,  because  of  the  finite  length  of  the  ROI  and  the  dispersive  nature  of 
the  waveform  due  to  the  perspective,  the  higher  the  dP  is,  the  less  accurate  the  flow  speed  is. 
Thus,  there  is  a  tradeoff  between  the  above  two  factors.  In  the  real  application,  we  pick  the  dP 
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value  to  be  about  l/10th  of  the  ROI  length.  We  will  assume  in  the  following  discussion  that  this 
dP  value  corresponds  to  two  correlated  frames  which  are  N y  frames  apart. 

In  the  previous  sections,  we  assumed  that  the  background  is  uniformly  zero.  In  reality, 
however,  the  background  image  will  not  be  zero.  Thus,  in  order  to  be  able  to  extract  the 
waveform  of  the  actual  moving  vehicles,  we  need  to  subtract  the  background  waveform.  There 
are  two  ways  of  subtracting  the  background  waveform.  One  is  by  obtaining  an  actual  background 
image  and  its  waveform,  the  other  is  by  using  a  frame  image  and  its  waveform.  We  will  discuss 
both  methods  below. 

A.  Obtaining  an  Actual  Background  Waveform 

Assume  that  gf  ( P) ,  0<  i  <  M ,  are  waveforms  for  M  consecutive  frames.  There  are 

two  ways  of  computing  the  background  waveform,  gb  ( P) :  one  is  by  doing  a  M  frame 

windowing  average,  or  finite  impulse  response  (FIR)  filtering,  and  the  other  is  by  doing  a 
running  average,  or  infinite  impulse  response  (HR)  filtering. 

(a)  FIR  Filtering 

In  this  method,  we  average  the  M  consecutive  frames  to  obtain  the  background 
waveform, 


gb(P) = go(m  g,(n+-+ sm-i(p) =_i  £gi(P)  (IVA1) 

A4  A 1  j- o 


This  is  a  moving  window  averaging.  After  we  have  obtained  the  background  waveform,  we  can 
then  subtract  it  from  the  correlated  waveforms  to  obtain  no-background  correlated  waveforms. 


gi\P)  =  gi(P)-gb(P) 


(IV.  A.  2) 


We  can  then  apply  the  correlation  algorithm  to  obtain  the  pixel  shift. 

r(P)=  £  g,V(/,D&’(«--P) 

Pl=Ii 

Pl=Yi 

(IV.  A.  3) 

For  simplicity,  we  have  dropped  the  subscript  in  the  correlation  symbol  r.  From  now  on,  we  will 
use  r  to  represent  the  cross-correlation  function. 
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(b)  IIR  Filtering 


In  this  method,  we  do  a  running  average,  or  a  IIR  filtering.  The  background  waveform  is 
updated  by  a  certain  percentage  of  its  previous  value  and  the  new  frame  waveform.  The 
mathematical  forms  are  as  follows. 

gb,(P)=to,-i(P)+Q-fi)gt(P) 

l</'<00  0<fi<  1  (IV.A.4a) 

gb,o(P)  =  So(P)  (IVA4b) 

where  the  coefficient  /?  controls  the  percentage  of  the  new  frame  waveform  to  be  averaged  into 

the  background.  When  ft  - 1 ,  the  background  waveform  will  be  same  as  its  initial  value 

gb0(P)  all  the  time,  which  is  not  desirable.  When  ft  =  0,  the  background  waveform  will  be 

equal  to  the  new  frame  all  the  time.  This  results  in  the  frame  subtraction  algorithm  which  we  will 
discuss  later.  Methodologically,  this  method  is  in  between  the  windowing  averaging  algorithm 
and  the  frame  subtraction  algorithm. 

After  we  have  obtained  the  background  waveform,  we  can  then  subtract  it  from  the  correlated 
waveforms  to  obtain  no-background  correlated  waveforms. 


g,\p)=g,(p)-gbJ(p) 


(IV.A.5) 


We  can  then  apply  the  correlation  algorithm  to  obtain  the  pixel  shift. 

i  a+W/'(«)a'(«--P) 

Pl=Yx 

=  tig,.,,  Apt) -gbAPmg,(.pi-p)-gv(.pi-p)i 

Pl=Yx 


(IV.A.6) 

The  above  two  methods  show  two  ways  of  obtain  background  waveform.  In  order  to 
obtain  a  good  background  waveform  with  the  above  two  methods,  the  number  of  times  a  vehicle 
is  at  a  particular  pixel  position  has  to  be  far  less  than  the  number  of  averaging  frames.  In  other 
words,  most  of  the  frames  don’t  have  any  vehicles  in  a  particular  pixel  position.  In  this  situation, 
the  vehicles  that  are  present  in  that  particular  pixel  position  in  certain  frames  are  averaged  out, 
and  thus  leave  only  very  small  intensities  in  the  final  background  waveform.  This  requires  that 
the  traffic  be  light.  In  the  case  that  the  traffic  is  heavy,  most  of  the  frames  will  have  a  vehicle  in  a 
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particular  pixel  position,  in  other  words,  that  particular  pixel  position  will  be  heavily  covered  by 
vehicles  during  the  time  period  of  the  background  averaging,  thus  the  intensities  of  the  vehicles 
that  are  in  that  particular  pixel  position  will  not  get  averaged  out  over  all  the  frames.  In  stead,  it 
will  have  a  high  intensity  left  over  in  the  background  waveform.  In  the  extreme  case  that  there  is 
a  vehicle  in  a  particular  pixel  position  in  every  frame,  the  resulting  background  waveform  will  be 
the  actual  background  waveform  plus  the  average  waveform  of  vehicles.  If  we  subtract  this 
background  waveform  from  the  correlated  waveforms,  we  will  reduce  the  contrast  of  the  actual 
vehicle  intensities,  thus  increase  the  error  of  the  flow  speed  computation.  Since  in  a  heavy  used 
highway,  this  will  happen  quite  often,  we  will  not  use  the  background  waveform  obtained  by  the 
above  two  methods  for  background  subtraction.  In  the  following,  we  will  discuss  the  frame 
subtraction  algorithm  for  background  subtraction. 

B.  Frame  Subtraction  Algorithm 

Frame  Subtraction  algorithm,  as  it  stands,  subtracts  two  frames  to  remove  the  background 
waveform.  For  this  purpose,  we  can  subtract  both  correlated  waveforms  by  a  common  frame,  as 
follows. 


g,'(P)  =  g,(P)-gj(P)  j*i  (IV.B.l) 

We  can  then  apply  the  correlation  algorithm  to  obtain  the  pixel  shift. 

r(P)  =  £  g„N;(P\)g,\P\-P) 

P\-Yi 


=  £  (/’!)-«,(«)][& (Pl-P)-gj(Pl-P)] 

Pl=Yi 


j  ^  i  and  j  &  i  +  N f  (IV.B.2a) 

However,  there  is  a  pitfall  with  this  method.  In  order  to  show  this,  we  expand  the  multiplication 
in  Eq.(IV.B.2a). 

r(P)  =  £  •[&*„.(«)&(«-  P)  ~  gj(PVg,(Pl  -  P ) 

Pl-Yi 

-g,+N,  (n)gj(n  -p)+ gj(Pi)gj(Pi  -  f)] 

j  *  i  and  j  +  Nj-  (IV.B.2b) 
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Unlike  the  background  subtraction,  where  the  background  waveform  is  obtained  by  doing  the 
averaging  over  many  to  infinite  frames,  which  also  averages  the  random  noise  out,  the  frame 
waveform  g  •  ( PI) ,  which  is  used  for  subtraction  in  this  method,  contains  random  noise.  Thus, 

the  average  of  the  random  noise  in  the  first  three  terms  in  Eq.(IV .B.2b)  will  be  zero  while  that  of 
the  last  term  will  not  be  since  it  correlates  by  itself.  Since  the  peak  of  the  last  term  resides  at  zero 
shift,  if  the  random  noise  happens  to  be  big  in  certain  cases,  the  last  term  will  dominate,  and  thus 
will  provide  the  overall  peak  at  zero  shift,  which  causes  the  error  in  the  flow  speed  computation. 
Therefore,  we  will  not  use  this  method. 

In  order  to  reduce  the  influence  of  the  random  noise,  we  propose  the  use  of  two  frames 
for  background  subtraction.  In  other  words,  each  correlated  frame  subtracts  a  different  frame, 

g,,(P)  =  g,(P)-g](P)  J**  <IV-B-3a> 

and 

g,+N,\P)  =  St+Nf(P)-gAP)  l^i  +  N f,j*l 

(IV.B.3b) 

We  can  then  apply  the  correlation  algorithm  to  obtain  the  pixel  shift. 

r(P)=  £  glt/l,\Pi)g,'(Pl-P) 

PUYX 


, and  j*l  (IV.B.4a) 

Expand  the  multiplication  in  Eq.(IV.B.4a). 

r(P)=  £  [g(+A,/(«)g,(^-^-&(«)g,(^-^) 

PUYX 

-gHN,(.p\)gj(pi  -p)+ g,(«)g,(«  -  p )i 

,  and  j  ^  /  (IV.B.4b) 
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From  Eq.(IV.B.4b),  we  see  that  none  of  the  subtracted  frames  correlates  with  itself,  thus  the 
influence  of  the  random  noise  is  reduced. 

In  the  actual  computation,  in  order  not  to  subtract  most  of  a  vehicle  out  in  the  frame 
subtraction,  we  have  to  require  that  each  subtracted  frame  be  separated  certain  number  of  frames 
from  its  corresponding  correlated  frame.  Since  the  distance  between  two  correlated  frames  are 
Ny  frames  apart,  we  can  set  the  number  of  frames  between  the  subtracted  frame  and  its 

corresponding  correlated  frame  to  Ny  + 1 .  Thus, 

g,\P)  =  g,(P)-g,^fAP)  (IV.B.Sa) 

and 

Si+Nf  '(P)  =  Si+Nf  (P)  ~  Si+2Nf+l(P)  (IV.B.5b) 

and  the  correlation  function  is 

r(P)=  £  g lfNf'(Pl)g,’(.Pl- P) 

P\~Y\ 

“  S  \-§i+Nr  (PI)  ~  gi+2Nf+  .!(«)][&(«  -P)~  gi+NfAPl  -  P)] 

p  i=r, 

(IV.B.6) 

5.5  Conclusions 

From  the  previous  sections,  we  conclude  that 

(a)  The  collapsed  waveform  algorithm  reduces  the  complexity  of  a  2-D  image  while  preserving 
sufficient  information  needed,  which  increases  our  computation  efficiency.  The  only  drawback  is 
that  the  width  information  is  lost.  However,  since  the  correlation  algorithm  does  not  require  the 
knowledge  of  the  vehicle  width,  this  loss  of  information  does  not  affect  our  result. 

(b)  In  the  case  that  the  perspective  is  ignored,  or  the  calibration  factor  is  assumed  to  be  constant 
in  the  whole  y  direction,  the  correlation  algorithm  is  perfect  for  computing  the  waveform  shift. 

(c)  In  the  case  that  the  camera  perspective  is  included  in  our  computation,  or  the  calibration 
factor  is  varied  along  the  whole  y  direction,  the  pixel  shift  computed  by  the  correlation  algorithm 
is  the  median  of  the  pixel  shifts  of  all  the  vehicles  in  the  ROI.  This  provides  a  way  for 
perspective  compensation.  It  also  proves  that  the  correlation  algorithm  is  also  applicable  for  flow 
speed  computation  in  the  varied  calibration  factor  case. 
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(d)  For  background  subtraction,  using  an  averaged  background  waveform  reduces  the  contrast  of 
the  interested  object  intensity,  that  is,  the  vehicle  intensity.  The  use  of  a  common  frame  in  frame 
subtraction  preserves  the  contrast  of  the  vehicle  intensity,  but  enhances  random  noise,  thus 
reduces  the  accuracy  of  the  flow  speed  computation.  In  order  to  both  preserve  the  contrast  of  the 
vehicle  intensity  and  reduce  the  random  noise,  we  introduce  the  four-frame  correlation 
algorithm.  Two  of  the  frames  are  used  as  the  correlated  frames  and  the  other  two  are  used  for 
background  subtraction  purpose. 
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6.0  Camera  Perspective 

6.1  Introduction 

With  a  traffic  surveillance  system  using  cameras,  large  region  of  traffic  can  be  monitored 
simultaneously.  However,  for  monitoring  and  control  of  the  traffic,  the  region  of  interest  is 
important.  To  our  system,  the  TFVC  system,  some  algorithms  impose  some  requirements  on  the 
camera  perspective.  Thus,  we  will  derive  the  relationship  between  camera  orientation  and  flow 
speed  calculation  and  discuss  its  significance. 

6.2  Relation  between  Camera  Perspective  and  Flow  Speed  Computation 

In  the  following,  we  will  use  optical  principle  to  derive  relations  between  the  camera  pole 
height,  the  angle  between  the  camera  main  optical  axis  and  horizontal  axis,  and  the  calibration 
factor.  In  the  following  derivation,  all  units  are  in  foot. 

Let 

f  =  focal  length  (feet) 

h'  =  camera  height  (feet) 
d  =  distance  of  the  pole  to  the  lane  (feet) 

(3  =  angle  between  camera  main  optical  axis  and  ground  (degree) 
a  =  angle  between  camera  main  optical  axis  and  traffic  lane  (degree) 

©  =  CCD  size,  or  pixel  size  =  10  pm/pixel  =  10  /  (12  *  2.54  *  104) 

=  1/30480  (feet/pixel) 

pm  ~  maximum  number  of  pixels  in  the  image  plane  in  vertical  direction 
=  480  (pixels)  (This  corresponds  to  the  vertical  field  of  view). 

In  FIGURE  11,  the  coordinate  systems  for  the  traffic  and  the  image  planes  are  Oi  -  Yi 
and  O2  -  Y2,  respectively.  The  origin  Oj  for  the  image  plane  is  at  the  top  of  the  image  plane. 
Thus,  if  we  assume  that  Ci  is  the  center  point  of  the  image  plane,  then  distance  O1C1  =  ©  *  (pm/ 

2-1)  (feet).  The  origin  O2  for  the  traffic  plane  is  at  the  bottom  of  the  pole.  C2  is  the  point  where 
the  camera  main  optical  axis  and  the  traffic  lane  intersect.  The  variables  are  defined  as  follows: 

h  =  OO2  (feet)  =  effective  camera  pole  height  =  -v h'2  +d2 
Lx  =  O1C1  (feet)  =  a>*(pml  2-1)  (feet) 

L2  =02C2  (feet)  =  h cot  a  =  ^h'2+d2  cot  a  (feet) 
p-  image  position  on  the  focal  plane  of  the  camera  (pixels) 

=  O1A1  (pixels)  (0  <  p  <  pm  - 1) 
jPj  =  image  position  on  the  focal  plane  of  the  camera  (feet) 

=  0,A,  (feet)  (0  <  yl  <  ©  *  (pm- 1)) 
y2  =  vehicle  position  on  the  highway  =  O2  A2  (feet) 
z  =  A2  C’2  (feet) 
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/z^OCyfeet) 

hj  =  C’  2  C2  (feet) 

From  the  above  definition,  we  have 


FIGURE  1 1  Schematical  Drawing  of  the  Camera  Perspective 

From  triangle  AC2O2O  ~  triangle  AC52A20  in  FIGURE  11, 

From  Fig.  FIGURE  11,  triangle  ACiAjO  ~  triangle  AC2A2O,  this  gives 

hzh.=L 

z 
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(II 2) 


yi  =  Li- 


From  AC2O2O,  we  have 


C2O  ~  /Zj  +  /?2  — - 

s  in  a 


hx  =  — - \ 

si na 


(H*3) 


From  AA2C2C2,  we  have 


h2=(L2-y2)cosa 


(II.4) 


z  =  {L2  -y2)sina 


(II.5) 


Plug  Eq.(II.4)  into  Eq.(II.3),  we  have 


hx  = - ( L2  -)>2)cosa 

sina 


(II.6) 


Plug  Eqs.  (II. 5)  and  (II.6)  into  Eq.(II.2),  we  have 


y\  =  h 


f(L2  -^2)sin« 


sin  a 


=  LX- 


-~{L2-y2)cosa 

a 

f(M  -72)sin2^ 

h-(L2  -,y2)sin#cos# 


2/(4  -.P2)sin2ar 
2 h-(L2  -y2)sin2a 


(II- 7) 


With  Eqs. (II. la)  and  (II. 7),  we  have 


p=—(L  ) 

co  1  2h  -  (L2  -y2)smla 


(II- 8) 


53 


From  definitions  of  Li  and  L2,  we  have 


^  f(hcosa-y2sma) 
^  2  co(hsma  +  y2cosa) 


(II.9a) 


Because  we  have  the  access  to  the  image  picture,  it  is  better  to  express  y2  as  a  function 
of  p .  From  Eq.(II.9a),  we  have 

/  cosa:  -  a>{—  - 1  -  p)sina 

y2  =  h - 2 -  (11.9b) 

/  sina  +  o(—  - 1  -  p)cosa 
2 

We  can  simplify  Eqs.(II.9a)  and  (b).  Let 

(11.10a) 


(II.  10b) 

where  the  indices  y2  and  p  indicate  the  dependence  of  C,  and  C  on  y2  and  p,  respectively,  we 
can  then  rewrite  Eq.(II.9a)  and  (b)  as 


tanf(y2)s^- 

- 1  -  P) 

tanC(p)  = - 7 - 


p-irr-- 1)  “  —cot  (a  + %(y2)) 

2  co 

and 

y2  =  hcot  (a  +  £(p)) 

Because  0<  p  <  pm- 1 ,  from  Eqs.(II.  10b)  and  (II.  1  lb),  we  have 
hcot(a  +  £(0))  <y2<  hcot(a  +  £(pm  - 1)) 

where 

1) 

tanf(0)  =  — ^ - 

and 


(II.  11  a) 
(II.  lib) 


(II.  12a) 


(II.  12b) 
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tanfCft,  - 1) s  ~~2f 


(11.12c) 


So,  the  minimum,  maximum  values,  and  range  of  y2  corresponding  to  the  whole  camera 
field  of  view  are: 


J2lnin=/lCOt(«  +  4'(0)) 


(II.  13a) 


y 2 max  =  hCOt(a  +  C(Pm  ~  0) 


(II.  13b) 


A!7 2  =  3^2  max  — 


=  Mcot  (a  +  £(pm  ~  1))  -  cot  (a  +  ^(0))] 


(II.  13c) 


For  an  ROI  centering  at  p0  with  range  P  in  the  image  plane. 


p0-P/2<p<p0  +  P/2-\ 


(II.  14a) 


thus  from  Eqs.(II.  10b)  and  (II.  1  lb),  we  have 


hcot(a  +  £(p0  -  P  /  2))  <  y2  <hco\(a  +  £{p0  +  P  /  2-1))  (II.  14b) 


where 


tan^Q  -P/2)  = 


/Pm  +  P  x 

^2 - 1_  A>) 


(II.  14c) 


tan  ^(p0  +  P/2-l)  = 


(II.  14d) 


So  the  center,  minimum,  maximum,  and  range  of  y2  are 


^center  =  /*COt(a  +  aA>)) 


(II.  15a) 


y2mb  =  hcot(a  +  C(p0  -PI  2)) 


(II.  15b) 


y2max  =  hco\(a  +  C(Po  +  PI  2-1)) 


(II.15c) 


Ay’2=y  2^-/2^ 
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=  /z[cot(a  +  £(p0  +  P/2-1))- cot(a  +  C(P0  ~  p  1 2))1 

(II.15d) 

Now,  we  will  derive  the  relationship  between  the  calibration  factor  y  (feet/pixel)  and  the 
vehicle  position  p .  The  calibration  factor  y  is  defined  as  follows. 


(fy2 


(II.  16a) 


Differentiating  Eq.(H9b)  gives 


[/  sin  a  +  o)( —  - 1  -  p)cosaf 
2 


[/2  +G)\Iy- 1  -  pf  ]sin2  (a  +  £(p)) 


In  our  code,  we  use  MPH  which  is  defined  as 


(II.  16b) 


(11.16c) 


MPH= 


miles  /  hour 
pixels  /  sec 


(II.  17a) 


The  relationship  between  MPH  and  y  is 


MPH  =  —y 
22 


(II.  17b) 


From  Eq.(II.16b),  we  get 


t  /  sina  +  G)(—  - 1  -p)  cos  a 
1  _  _  2  _ 

Jy  4M1 


1  /sing  +  fl>(^--l)cosg  ^CQSCg 

Jr 


(II.  18a) 
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(II.  18b) 


From  Eq.(II.18a),  we  see  that  inverse  of  square  root  of  calibration  factor,  l/*Jy  ,  is  a 
linear  function  of  the  image  position  p .  We  will  use  this  relation  to  calibrate  the  flow  speed 
according  to  vehicle  position  in  next  section. 

Now  we  will  derive  some  limits  on  the  camera  pole  height  and  camera  angle.  Assume 
that  vehicle  speed  is  v,.  and  the  time  difference  between  two  correlated  frames  is  dt ,  then  the 

distance  that  the  vehicle  in  position  y2  moves  in  time  dt  is 

dy2=Vrdt  (II.  19a) 

which  gives  the  pixel  movement  dp0  in  image  position  pQ 


As  expected,  if  / ,  h,  and  a  are  fixed,  the  calibration  factor  at  the  right-hand  side  of 
Eq.(II.  19c)  is  a  constant  at  each  specific  point  p0  in  the  image  plane.  Thus,  for  a  fixed  dt ,  as  Vr 
increases,  dpQ  increases.  When  vr  achieves  the  maximum  value  vrmax,  dp0  achieves  its 
maximum  value  dpd* ,  where  the  superscript  dt  indicates  the  dependence  of  dp^  on  dt . 
Hence  Eq.(II.  19c)  becomes 
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ddt  [f  +  co2{^- 1  -  jp0)2]sin2(a  +  £(p0)) 

UP0,max  _  2  ____________ 


Vrm  ax^ 


fcoh 


(11.20) 


For  flow  speed  computation  to  be  reliable  and  accurate,  we  require  that  a  vehicle  stay  in 
the  region  of  interest  (ROI)  at  least  Nmm  times.  Assume  that  the  height  of  the  ROI  is  P ,  thus 


dpL ax  ^ 


(11.21) 


Eqs.  (11.20)  and  (11.21)  yield 


vrmaMf2  +0)2(^-\-  p0)2]sin2  (a  +  £(p0))  p 
- L - < -  (11.22) 


fcoh 


In  the  following,  we  will  derive  limits  on  camera  angle  cc  and  pole  height  h  . 
A.  Derivation  of  Maximum  Camera  Angle  a 
Rearrange  Eq.  (11.22),  we  get 

L / 2  +  (O1  - 1  -  PoY  ]sin2 («  +  £(Po))  £  (ILA- 1} 

2  v^at  AL* 


r  max  mm 


or 


sin  (a  +  £(p0)): 


1 

fcoh  P 

i/2  +  ®2#- 

_  J  _  ^rmax^  ^min 

0<a<  90°  (II.A.2) 


So,  a satisfies  the  following  condition 


a  =  arcsin 

max 


1 


fcoh  P 


[  f 2  +  co2{—  - 1  -  Pq)2  Vrmax^  A/r,nin 
2 


<T(Po) 


0<«  <90°  (II.  A.  3) 
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From  Eq.(II.A.3),  we  can  see  that  amax  is  a  monatomic  increasing  function  of  h  and  a 
monatomic  decreasing  function  of  dt  and  f . 


For  fixed  h  and  f ,  as  dt  decreases,  etmax  increases.  However,  in  order  to  be  able  to 
compute  flow  speed,  dt  has  a  minimum  dtmin  which  is  the  time  between  two  closest  correlated 
frames.  In  our  case. 


dt 


min 


TS(  S6C) 


(II.A.4) 


because  of  our  4-frame  correlation  scheme.  Use  dtmm  andEq.(II.A.3),  we  get 


Now  we  can  calculate  the  maximum  camera  angle  <2max .  Assume  that 

P  =  100(pixels ) 
p0  =  120  (pixels) 

vmax  =  80  (miles  /  hour )  =  352  /  3 {feet  /  s ) 
h  =  40  {feet) 

f  =  6  ~  60(/w/w)  =  5/254-50/ 254(/ee/) 

(i)  Case  1,  /  =  5  /  25 feet) ,  that  is,  camera  is  zoomed  all  the  way  out: 


(II.A.6a) 

(II.A.6b) 

(II.A.6c) 

(II.A.6d) 

(II.A.6e) 

(II.A.6f) 


(1/30480)  *(--1-120) 

CiPo)  =  arctan - - - =  1 1.2°  (II. A. 7) 

5/254 
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«max  =  12-7° 


(II.  A.  8a) 


With  this  angle,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range  the 
camera  can  see,  and  the  calibration  factor .  From  Eqs.(II.13a)-(c),  (II.  15b),  and  (II.  16b),  we  have 


^2min=40 


(5  /  254)cos24.4°  -  (1  /  30480)(— —  l)sin24.4° 

| - - - — - 2 - 

(5  /  254)sin24.4<>  +  (1/  30480)(4^-  l)cos244” 


^2min  =  39(/e«0 


(II.  A.  8b) 


^max^40 


(5  /  254)cos24.4°  +  (1  /  30480) - sin24.4° 

i  - 2 - 

(5  /  254)sin24.4°  -  (1  /  30480) ^cos24.4° 


>’2max=881(/^0 

Ay 2  =  y2max  ~  ^min  =  881  -  39  =  842 (feet) 


(II.  A.  8c) 


(II.A.8d) 


=  (!  /  30480)  *  40 — 

/po  (5/ 254)*  sin2  24.4° 


MPH  =  —/  =  0.266 
22  7 


(II.A.8f) 


We  see  that  the  distance  of  our  ROI  to  the  pole  for  case  (i)  is  only  88  feet  for  the 
maximum  angle.  And  the  range  that  camera  can  see  is  from  39  feet  to  about  881  feet,  or  842  feet 
(—1/6  mile)  range. 

(ii)  Case  2,  /  =  50  /  254 (feet) ,  that  is,  camera  is  zoomed  all  the  way  in: 


(1/30480)  *40 


«max  arcsin j  ^ ;  3)  *  / 15)  *  (50  /  254)  5 


a  =75° 

“max  '  •*' 


(II.  A.  9a) 
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With  this  angle,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range  the 
camera  can  see,  and  the  calibration  factor .  From  Eqs.(II.  1  la)-(  c),  (II.  13),  and  (II.  14b),  we  have 


We  see  that  the  distance  of  our  ROI  to  the  pole  for  case  (ii)  is  about  303  feet  for  the 
maximum  angle.  And  the  range  that  camera  can  see  is  from  232  feet  to  about  439  feet,  or  207 
feet  (-1/25  mile)  range. 

In  the  above,  we  obtain  the  maximum  camera  angle  corresponding  to  zoom-out  and 
zoom-in  focal  lengths  and  the  minimum  dtmiB,  and  its  related  quantities,  such  as  the  center 
distance,  the  minimum  and  maximum  distances,  and  the  range  that  the  camera  can  see.  In  the 
following,  we  will  derive  similar  set  of  equations  base  on  our  commonly  used  dt  value. 
Currently,  we  use  dt  =  1  /  3(sec) ,  or  10  frames  between  two  correlated  frames.  With  this  value 


and  the  set  of  parameters  in  Eqs.(II.7a)-(  e),  we  recalculate  the  maximum  angle  ametx  as 
follows. 

(iii)  Case  3,  /  =  5  /  25A{feet) ,  that  is,  camera  is  zoomed  all  the  way  out: 


a 


max 


=  arcsin 


(1/30480)  *40 


(352  /  3)  *  (1  /  3)  *  (5  /  254) 


100 

5 


a 


max 


=  n° 


(II.A.IOa) 


With  this  angle,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range  the 
camera  can  see,  and  the  calibration  factor  .  From  Eqs.(lla),  (lib),  (11c),  (12b),  and  (14),  we 
have 


^center  =4QC0t  11°=  206(/^) 


(II.  A.  10b) 


(5  /  254)  cosl  1°  -  (1  /  30480)(-^- 

3/2  min  =  40  480 

(5  /  254)  sin  1 1°  +  (1  /  30480)(-— 
y2  min  =  62(feet) 


-  l)sinir 


-  l)cosll° 


(II.  A.  10c) 


3^2  max  =  °°(fee  0 

2  =  3^2  max  —  3;2min  =  °°(Jeet) 

(1/30480)  *40 

y  center  -  (5  /  254)  *  S^2  1 1° 

Y  center  = 

MPH  =  —r  =  1.25 
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(II.A.10d) 

(II.A.IOe) 


(II.  A.  1  Of) 
(II.A.10g) 


We  see  that  the  distance  of  our  ROI  to  the  pole  for  case  (iii)  is  about  206  feet  for  the 
maximum  angle.  And  the  range  that  camera  can  see  is  from  62  feet  to  infinity. 

(iv)  Case  4,  /  =  50  /  254(^ee0 ,  that  is,  camera  is  zoomed  all  the  way  in: 


62 


^  max 


=  arcsin 


(1/30480)  *40 


'(352/  3)  *(1/3)  *(50/  254) 


100 

5 


amax=3A°  (H.A.lla) 

With  this  angle,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range  the 
camera  can  see,  and  the  calibration  factor  .  From  Eqs.(lla),  (lib),  (11c),  (12b),  and  (14),  we 
have 


^center  =  40cOt3.4°  =  673(/^)  (II.A.llb) 

(50  /  254)cos3.4°  -  (1  /  30480)(—  -  l)sin3.4° 

^min  ~  40  480 

(50  /  254)  sin 3.4°  +  (1  /  30480)(—  -  l)cos3.4° 

^2m,„  =  402(/ee0  (II.  A.  11c) 

(50/  254)cos3.4°  +  (1  /  30480)  *  —  sin3.4° 

3*2  max  =  40 - - 

(50  /  254)  sin  3.4°  -  (1  /  30480)  *  -^cos3.4° 

JW  =  2066(  feet)  (II.A.lld) 

(II.  A.  lie) 


(II.  A.  Ilf) 
(II- A.  1  lg) 


A y2  =  3*2  max  -  3^2 min  =  2066  ~  402  =  1664 (feet) 

(1/30480)  *40 

/center- (50/ 254)*  sin2  3.4° 

/center  =  190 

MPH  =  —/  =  1.29 
22 
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We  see  that  the  distance  of  our  ROI  to  the  pole  for  case  (iv)  is  673  feet  for  the  maximum 
angle.  And  the  range  that  camera  can  see  is  from  402  feet  to  about  2066  feet  (—2/5  mile),  or 
1664  feet  (—1/3  mile)  range. 

From  the  above  results,  we  can  see  that  in  order  to  satisfy  our  requirements  on  vehicles 
being  in  the  ROI  for  at  least  =  5  times  with  dtmin  =  1  /  3(sec) ,  the  maximum  camera 

angle  is  1 1°  for  /  =  5  /  254 (feet)  (camera  is  zoomed  all  the  way  out),  while  the  maximum 

camera  angle  is  3.4°  for  f  =  50/  254 (feet)  (camera  is  zoomed  all  the  way  in).  Even  though 
the  calibration  factors  for  center  position  in  both  cases  are  similar,  the  distances  of  the  center 
position  to  the  pole  are  quite  different.  The  distance  of  the  center  position  to  the  pole  in  case  (iii) 
is  far  smaller  than  that  in  case  (iv)  (206  feet  in  case  (iii)  to  673  feet  in  case  (iv)).  That  is,  we  can 
see  closer  distance  in  case  (iii)  than  in  case  (iv).  Thus,  it  is  beneficial  to  use  /  =  5  /  254 {feet) 
(camera  is  zoomed  all  the  way  out)  for  our  flow  speed  calculation.  Another  advantage  on  using 
f  —  5/  254 {feet)  is  for  camera  preset.  If  camera  is  zoomed  all  the  way  out,  the  preset  will 
find  its  zoom  position  easier  and  quicker.  There  is,  however,  a  disadvantage  on  using 
f  =  5  /  25A{feet) .  Because  of  the  different  geometry’s  in  different  areas,  the  traffic  lanes  may 

have  a  big  angle  from  vertical  direction  in  some  areas  for  camera  zooming  all  the  way  out,  which 
presents  some  problem  to  our  lane  definition  algorithm  due  to  the  way  it  was  designed. 

B.  Derivation  of  Minimum  Pole  Height  h 


In  the  above  section,  we  derived  various  quantities  related  to  maximum  camera  angle 
ocmax .  In  this  section,  we  will  derive  minimum  pole  height  hmin  and  its  related  quantities. 


Rearranging  Eq.(II.22)  gives 


vrmax^[/sin«  +  0)(~ -  1  -  ^COStt]2 


< 


fcoh 


N  ■ 

1  y  ram 


(II.B.1) 


Vrmax^t/  sin«  +  ~  1  “  P)  C0SaY  Ni 


mm 


h> 


fcoY 


(II.  B.  2) 


Thus,  the  minimum  pole  height  hmm  is 
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since  +  o)( - 1  -  p)cosa]z  N. 


mm 


^min 


fcoY 


(II.B.3) 


Assume  that  dt  takes  on  its  minimum  dt  {  as  discussed  in  Section  A,  then 


^min 


max  ^  min  [/  sin  a  +  co{^~  - 1  -  p)  cosa]2  Nmin 


(II.B.4) 


As  in  Section  A,  we  will  use  the  center  portion  of  the  image  for  computation.  Therefore, 


h  _  VrmAinAninsin  « 
min  coY 


(II.B.5) 


Eq.(II.B.5)  shows  that  hmin  is  a  monotonic  increasing  function  of  a .  Thus,  in  order  for 

the  camera  to  be  able  to  have  a  bigger  maximum  angle,  the  pole  height  has  to  be  higher. 
Although  a  higher  pole  means  a  bigger  maximum  camera  angle,  it  does  not  mean  that  its  center 
distance  ^center  is  cl°ser-  Eq.(  II.B.5)  into  Eq.(II.  1 1  a),  we  get 


v  _  Vrmax^min^minSin2a 

^2center  2  coY 


(II.B.6) 


From  Eq.(  II.B.6),  we  see  that  when  a  =  45° ,  ^center  reaches  its  maximum.  Center  >s 
a  monotonic  increasing  function  of  a  for  0°  <  a  <  45°  and  a  monotonic  decreasing  function 
of  a  for  45°  <a<  90° .  Thus,  when  a  increases  from  0°  to  45° ,  the  minimum  pole  height 
increases,  and  the  center  distance  ^center  that  camera  can  see  increases,  when  a  increases  from 

45°  to  90° ,  the  minimum  pole  height  increases,  but  the  center  distance  ^center  that  camera  can 
see  decreases. 

From  the  above  discussion,  we  can  see  that  increaseing  pole  height  can  increase  the 
maximum  camera  angle  allowed,  but  it  does  not  necessarily  mean  that  the  distance  it  can  see  is 

closer.  For  the  maximum  camera  angle  that  is  less  than  45° ,  the  higher  the  pole,  the  farther  the 

center  distance  the  camera  can  see.  For  the  maximum  camera  angle  that  is  larger  than  45° ,  the 
higher  the  pole,  the  closer  the  center  distance  the  camera  can  see.  Therefore,  higher  pole  does  not 
mean  better.  Certainly,  if  there  are  objects  along  the  highway,  then  higher  pole  will  give  us  better 
view  of  the  highway. 
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With  a  =  45° ,  the  minimum  pole  height  and  the  center  distance  ^center  are 


^min  '  .^center 


^  r  max^min./^min 


2  coY 


(II.  B.  7) 


Use  the  set  of  parameters  in  Eqs.(II.A.7a)-(  c)  and  (II.A.7e),  we  can  compute  the 
minimum  pole  height  hmin  for  camera  zooming  all  the  way  out  and  in  as  follows: 

(i)  Case  1 ,  /  =  51 25  A(  feet) ,  that  is,  camera  is  zoomed  all  the  way  out 


From  Eq.(II.A.8a),  we  know  that  hmm  =  40 {feet)  corresponds  to  amax  =  24.4°.  In 
order  to  increase  maximum  camera  angle  amax ,  hmm  has  to  be  increased.  In  the  following,  we 
will  compute  several  values  of  with  respect  to  different  values  of  maximum  camera  angle 

Cl 

^  max  * 


(a)  =  30° 

(352  /  3)  *  (1  / 15)  *  (5  /  254)  *  5  *  sin2  30” 

-  (1/30480)  *100 

K „=59(/e«)  (IIB.8a) 


With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor .  From  Eqs.(II.  1  la)-(c),  (II.  13),  and  (II.  14b),  we 
have 


>W=59cot30°=102(/<*0 


(II.B.8b) 


(5 / 254)00830°  - (1  / 30480)(^p - 1)81030° 

J^min  —  ^  480 

(5  /  254)sin30°  +  (1  /  30480)(— -  - 1)  cos30° 
y?.min  =  47  {feet) 


(ll.B.8c) 
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3^2  max 


(5  /  254)cos30°  +  (1  /  30480)  *  ^sin30° 

2 

(5  /  254)sin30°  -  (1  /  30480)  *  —  cos30° 

2 


>;2max=410(/^0 

(II.B.8d) 

A y2  =  y2 max  -  3^2 min  =  410  -  47  =  363 {feet) 

(II.B.8e) 

(1/30480)  *59 

/center  ~(5/254)%sin2  3Q0 

/center  =  0-393 

(II.B.8f) 

MPH  =  —y  =  0.268 

22 

(II.B.8g) 

=  45° 

max 

h 


min 


(352  /  3)  *  (1  / 15)  *  (5  /  254)  *  5  *  sin2  45° 
(1/30480)  *100 


h^-WHJeet) 


(II.B.9a) 


With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor .  From  Eqs.(II.l  la)-(c),  (11.13),  and  (II.  14b),  we 
have 


^center  =H7cOt  45°  =  117(/^) 


(II.B.9b) 


y2 


mm 


117- 


(5  /  254)cos45°  -  (1  /  30480)(—  -  l)sin45° 

_ 2 _ 

(5  /  254)  sin  45°  +  (1  /  30480)(^  _  i)cos450 


^min  =  50(feet) 


(II.B.9c) 
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(5  /  254)cos45°  +  (1  /  30480)  *  —  sin45° 

3^2  max  —  1 480  „ 

(5  /  254)sin45°  -  (1  /  30480)  *  — cos45° 


3^2 max  _  273 (feet) 


(II.B.9d) 


A y2  =  3W  -  3'2min  =  273  -  50  =  223 (feet) 
(1/30480)  *117 

/center  -^^*^2  450 
/center  =0-390 

MPH  =  —y  =  0.267 
22 


(II.B.9e) 


(II.B.9f) 


(II.B.9g) 


(c)  «max  =  90° ,  that  is,  camera  looks  straight  down, 

(352  /  3)  *  (1  / 15)  *  (5  /  254)  *  5  *  sin2  90° 

/?min"  (1/30480)  *100 

h^  =  23A(feet)  (II.B.lOa) 


With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor .  From  Eqs.(H.  1 1  a)-(c),  (II.  13),  and  (II.  14b),  we 
have 


^center  =  234 cot  90°  =  0(feel) 


(II.B.10b) 


480 


(5  /  254) cos 90°  -  (1  /  30480)(—  -  l)sin90° 

3^2  min —  234  480 

(5  /  254)  sin  90°  +  (1  /  30480)(— —  l)cos90° 

dm* 


yim rn  =  -93  (feet) 


(II.B.lOc) 
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(5  /  254)  cos  90°  +  (1  /  30480)  * - sin90° 

3^2  max  =  234  Ton 

(5  /  254) sin 90°  -  (1  /  30480)  *  -^cos90° 

2r 

JW  =  94(/«tf)  (II.B.lOd) 


A y2  =J2max  -J2min  =94  +  93  =  187(/^)  (II.B.lOe) 


(1/30480)  *234 


/center  (5/ 254)*  sin2  90° 
y  =0390 

/  center  . 


MPH  =  —r  =  0261 
22 


(II.B.lOf) 

(II.B.lOg) 


(ii)  Case  2,  /  =  50  /  25A(feet) ,  that  is,  camera  is  zoomed  all  the  way  in 


From  Eq.(II.A.9),  we  know  that  hmm  =  40 {feet)  corresponds  to  <2max  =  7.5° .  As  in 
the  above  case,  we  will  compute  several  values  of  /imin  with  respect  to  different  values  of 
maximum  camera  angle  amax  below. 

(a)  ^max  =  13 

(352  /  3)  *  (1  / 15)  *  (50  /  254)  *  5  *  sin2 15° 
min”  (1/30480)  *100 

h^  =  \51{feet)  OLE.  11a) 


With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor  .  From  Eqs.(II.lla)-(  c),  (11.13),  and  (II.  14b),  we 
have 


^center  =157C0tl5°=586(/^) 


(II.B.llb) 


69 


(II.B.lle) 

(ILB.llf) 

(ILB.llg) 

0>)  «max  =  30° 

(352  /  3)  *  (1  / 15)  *  (50  /  254)  *  5  *  sin2  30° 
min_  (1/30480)  *100 

hmin=5S6(feet )  (II.B.12a) 

With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor  .  From  Eqs.(II.  1  la)-(c),  (11.13),  and  (II.  14b),  we 
have 

^center  =  586cOt30°  =  1015(/^)  (II.B.12b) 


Ay2  —  ^2 max  ^2 min  ~  ^96  ~*05  \9l(Jeet) 

(1/30480)  *157 
/center~(50/254)*sin215° 

r  =0391 

/  center  u-j:71 

MPH  =  —r  =  0.266 
22 
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y  2  min  =  586- 


(50 / 254)cos30°  -  (1  /  30480)(~  -  l)sin30° 

2 

(50  /  254)sin30°  +  (1  /  30480)(^  _  i)COs30° 

2 


^2  min  =  928 {feet) 


(H.B.12c) 


^2max=586 


(50  /  254)cos30°  +  (1  /  30480)  *  ^sin30° 

2 

(50  /  254)sin30°  -  (1  /  30480)  *  —  cos30° 

2 


^2max  =  1116(/^0 


(II.B.12d) 


AV2  =  J^max  "  3*2 min  =1116-928=  188(/g(?0  (II.B.12e) 


(n.B.i2f) 

(II.B.12g) 

From  Eqs.(H.B.12a)-(g),  we  see  that  with  camera  zooms  all  the  way  in  and  camera  angle 

at  30°,  the  camera  pole  has  to  be  590  feet.  As  camera  angle  increases,  the  pole  height  would 
need  to  be  higher,  which  is  unrealistic.  Thus,  we  will  not  compute  the  higher  camera  angle 
situation  for  this  case. 

As  in  Section  A,  we  will  also  derive  all  quantities  for  di  =  1  /  3(sec) ,  our  usual 
separation  between  two  correlated  frames. 

(iii)  Case  3,  /  =  5  /  254 {feet) ,  that  is,  camera  is  zoomed  all  the  way  out 

From  Eq.(II.A.lOa),  we  know  that  hmin  =  40  (feet)  corresponds  to  amax  =  1 1° .  In  the 
following,  we  will  compute  several  values  of  hmin  with  respect  to  different  values  of  maximum 
camera  angle  amsx . 


(1/30480)  *586 
/center"(50/254)*sin2  30° 

/center  =  0390 

MPH  =  —y  =  0.266 
22 
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(a)  max  15 


(352/ 3)  *(1/3)  *(5/ 254)  *5*  sin2 15° 
min~  (1/30480)  *100 


L  =  l%feet)  (II.B.13a) 

With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor  .  From  Eqs.(II.lla)-(  c),  (11.13),  and  (II.  14b),  we 
have 


^center  =  79C0tl5°  =  295(/^)  (ILB.13b) 


y  2 


min 


79 


(5/254)cosl5°  - (1  / 30480)(-^- -  l)sinl5° 
_  £* 

(5  /  254)  sin  15°  +  (1  /  30480)(^  -  l)cosl5° 

mrni 


y2min  =  106  {feet) 


(II.B.13c) 


3^2  max  =  °°(/^0 


(II.B.13d) 


A y2  =  y2 max  -  ^2min  =  P3'  13e> 

(1/30480)  *79 

/center  ~  (5  /  254)  *  sin2  15° 

/center  =  1965  (H.B.13f) 


MPH  = 


15 

22 


/  =  1.340 


(II.B.13g) 


(6)  «max  =  30° 

(352/  3)  *(1/3)  *(5/ 254)  *5*  sin2  30° 
hmin~  (1/30480)  *100 
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hmm=293(feet) 


(II.B.14a) 


With  this  height,  we  can  calculate  the  center,  minimum,  maximum  distances,  the  range 
the  camera  can  see,  and  the  calibration  factor .  From  Eqs.(l  la)-(c),  (II.  13),  and  (II.  14b),  we  have 


^center  =  293cOt30°  =  507(/^) 


(II.B.Mb) 


^2min=293- 


(5  / 254)cos30°  -  (1  /  30480)(—  -  l)sin30° 

; - 2. - 

(5  /  254)sin30°  +  (1  /  30480)(—  -  l)cos30° 

2 


3;2min=231(/^0 


(II.B.14C) 


(5  /  254)cos30°  +  (1  /  30480)  *  —  sin30° 

^2  max  =  293 - jjfc - 

(5  /  254) sin 30°  -  (1  /  30480)  *  cos30° 


y2max  =  2034(fee0 


(II.B.Md) 


A y2  =  y2 max  -  ^min  =  2°34  -231  =  1803(/e<?0 


(II.B.14e) 


(1/30480)  *293 
(5/ 254)*  sin2  30° 


y  center  =  1-953 


(II.B.14f) 


MPH  =  —v  =  1.332 

ir 


(II.B.14g) 


From  the  above  results,  we  see  that  when  the  maximum  camera  angle  is  30°,  the 
minimum  pole  height  required  is  already  about  293  feet.  For  bigger  maximum  camera  angle,  the 
minimum  pole  height  will  be  even  higher,  which  is  unrealistic.  Thus,  we  will  not  compute  the 

minimum  pole  height  for  cases  where  the  maximum  camera  angle  is  above  30° .  Also,  we  will 
not  compute  the  minimum  pole  height  for  cases  where  the  camera  zooms  all  the  way  in. 
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In  the  above,  we  compute  the  relationship  between  pole  height,  camera  angle,  and  the 
center  distance.  In  the  following,  we  will  discuss  how  the  error  in  camera  angle  affects  the 
calibration  factor. 


C.  Effect  of  the  Error  in  Camera  Angle  on  the  Calibration  Factor 


Differentiate  Eq.(H.12a)  with  respect  to  a,  we  obtain  the  absolute  change  of  the 
calibration  factor  related  to  error  in  a 

2  fooh{f  cos  a  -  co( -  - 1  -  /?)sin«) 
dy  = - — -2 - da  (Il.C.la) 

[/  sin  a  +  - 1  -  /?)cosa]3 

We  can  also  compute  the  relative  change  of  the  calibration  factor 


dy  2(/  cosa  -  6>(— - 1  -  p)sina) 

^  [/sin  a  +  at&i  - 1  -  p)cosa] 

2 


(ILC.lb) 


For  the  center. 


loch  cos  a 

- r - 1 

/sin  a 


(II.C.2a) 


i_j_££nteL_  _  _2  cot  cud  a 

y  center 


(II.C.2b) 


Eq.(II.C.2a)  shows  that  if  the  camera  angle  becomes  bigger,  or  da  is  positive,  then 
dy  center  neSative>  or  the  calibration  factor  becomes  smaller.  Also  from  Eq.(II.C.2a),  we  can 
see  that  the  absolute  change  of  the  calibration  factor  for  bigger  /  value  is  smaller,  assuming 
that  a  and  da  are  the  same  for  all  values  of  / .  However,  according  to  Eq.(II.C.2b),  the 
relative  change  of  the  calibration  factor  depends  only  on  angle  a ,  and  thus  is  the  same  for  all 
values  of  / . 
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The  above  shows  the  effect  of  da  on  the  change  of  the  calibration  factor  for  different 
values  of  f  when  a  and  da  are  the  same.  We  will  show  in  the  following  the  effect  of  da  on 

the  change  of  the  calibration  factor  for  different  values  of  f  when  the  calibration  factors  for 
different  /  values  are  the  same  before  camera  shifts.  Denote  the  calibration  factor  as  y  c .  Thus, 
from  Eq.  (II.  13), 


r  c 


coh 

f  sin2  a 


(II.C.3) 


From  Eq.(  II.C.3),  we  see  that  /  is  a  monotonic  decreasing  function  of  a ,  or  a  is  a 
monotonic  decreasing  function  of  f .  Thus  the  bigger  the  value  of  f  is,  the  smaller  the  angle  a 
is.  Substitute  Eq.(  n.C.3)  into  Eq.(  II.C.2b),  we  have 

^center  =-2rcCOt^«  (IIC4) 


From  Eq.(II.C.4),  we  see  that  for  the  same  da,  absolute  dycmteT  is  a  monotonic 
decreasing  function  of  a .  From  Eq.(  II.C.3),  we  know  that  a  is  a  monotonic  decreasing 
function  of  / .  Therefore,  absolute  dycenteT  is  a  monotonic  increasing  function  of  /  .  Thus,  for 
the  same  error  in  camera  angle,  the  higher  the  value  of  f  is,  the  more  effect  it  has  on  the  change 
of  the  calibration  factor.  In  this  case,  the  relative  change  in  the  calibration  factor  also  increases 
with  the  value  of  f . 

In  the  following,  we  are  going  to  derive  a  formula  on  the  effect  of  specific  number  of 
pixel  shift,  Ap,  due  to  the  error  in  camera  angle,  A  a ,  on  the  calibration  factor.  Because  the 

number  is  finite,  we  can  not  use  differential  form  any  more.  Assume  that  the  preset  angle  is  at . 

After  moving  the  camera  away  from  the  preset  position,  we  want  to  put  it  back  into  the  preset 
position.  Due  to  whatever  source  of  error,  the  camera  comes  back  to  the  preset  position  with  an 
error  in  camera  angle,  A  a .  So  the  final  angle  is 

a^=at+  A  a  (II.C.5) 


From  Eq.(II.9a),  we  have  the  initial  and  the  final  image  position  pt  and  Pj-  for  the  same  point 
y2  on  highway 


Pi=( 


ysize 

2 


-1) 


/  hcosOj  -  y >2  sin  a  f 
co  A  sin  or,  +  y2  cos  or, 


(II.C.6a) 


and 
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f  smotf  cosa,  -  sina,  cosa y 
o)  cosa,  cosa j  +  sina^  sina, 

APcenter  =  “tan  Att  (II.C.8) 

CO 

It  is  interesting  to  know  that  Apcenter  only  depends  on  the  error  in  camera  angle,  but  riot  the 
camera  angle  itself.  Thus  for  the  same  error  in  the  camera  angle,  the  pixel  shift  for  the  same  point 
on  the  highway  will  be  the  same,  no  matter  what  camera  angle  is.  Express  A  a  as  a  function  of 

^center  > we  have 


A  a  =  arctan(Apcenter  y)  (II.C.9) 

Eq.(  II.C.9)  says  that  for  a  same  point  ^center  on  the  highway,  in  order  for  it  to  shift  Apcenter  on 
the  image  plane,  the  camera  angle  has  to  shift  Aa .  Now  we  want  to  derive  a  formula  for  the 
Ay 2  shift  on  the  highway  for  the  same  pixel  point  p  on  the  image  plane  with  respect  to  the 

camera  angle  shift  Aa .  From  Eq.(II.9b),  we  have 
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C 0 


A y  2center  ^ 


sin2  at  +  A/?center  — —  sin2a; 


(II.C.13) 


Now,  we  can  calculate  the  change  in  the  calibration  factor.  From  Eq.(II.12a),  we  have 


[/  sin«,  +  ( - 1  -  p)cosajf 


(II.C.14a) 


Y/  = 


[f  sin  af  +  - 1  -  p)cosa  y]“ 


(II.  C.  14b) 


Thus, 


[/  sin«y  +  &(——■  - 1  -  p)  cosffy]2 


[/  sin  a,  +  - 1-  /?)  cos  a,  ]2 


(II.C.Mc) 


For  the  center  point  in  Eq.(  H.C.  1 1 ),  we  have 


Ay  =  ^(_J 

u/  center  r  v  ■  2 


/  surety  sin  a, 


Ay  =— r _ 

center  r  L  «  2 


/  sin  (a,  +Aa)  sin  a, 


(II.C.15a) 


center 


cch  1 
/  sin2  a, 


(II.C.15b) 


78 


So  the  relative  change  is 


A/ center  _  sifl2  g, 

7  center  sin2(a,  +  A«) 


(II.C.15c) 


Now  we  want  to  express  Ay  in  terms  of  Apcenter .  Plug  Eq.(  II.C.9)  into  Eqs.(II.C.  15a)  and 
(II.  C.  15c),  we  have 


and 


Ay 


center 


_  ah  sin2  at  -  sin2  (a,  +  Ad) 
f  sin2  (a,  +  Aa)  sin2  at 


ah  (sin2 at  +  cos2 ai  tanAa)tanAa 

~  f  o  1  2 

J  (sin  ai  +  —  sin 2a t  tanAa) 

2 


Ay  =_Ap  ^ 

/  center  '^/'center  r 2 


2,  sin2^  +Apcenter^-cos2a/ 


<y 

— i 

/ 


(sin^  +  Ap^^sn^) 


(II.C.16a) 


A/ 


center 


■Ap{ 


sin2a;  +  Apcenter  —  cos2a 
®  / 


center 


center 


^  (sina;  +  Apcenter  yCQsaty 


(II.C.  16b) 


With  Eqs.(  II.C.9),  (II.C.  13),  and  (II.C.  16),  we  can  calculate  some  specific  numbers.  For  this 
calculation,  we  will  use  the  set  of  parameters  in  Case  4  in  Section  A.  Also,  in  order  to  satisfy  our 
requirement  that  vehicles  stay  in  the  ROI  for  at  least  Nmin  times  for  both  camera  zooming  all 

the  way  out  and  in,  we  assume  that  af  =  3° .  We  will  consider  several  different  Apcenter . 

(i)  Case  1,  /  =  5  /  254 {feet) ,  that  is,  camera  is  zoomed  all  the  way  out. 

(a)  Apcenter  — 10 


79 


From  Eqs.(  II.C.7),  (II.C.9),  (II.C.  13),  and  (II.C.  16),  we  have 


y2  center  =  40cot3°  =  163(feet) 


(II.C.  17a) 


.  ,  1/  30480  .0,0 

A  a  =  arctan(10 - )  =  0.96 

5/254 


(II.C.  17b) 


10 


Ay: 


2center 


=  -40 


1/30480 

5/254 


.  2-0  in  1/30480  .  ,0 
sin  3  + 10 — - —  sm6 


2*5/254 


Ay  2center  =  ~^4(feet) 


(II.C.  17c) 


^center  =“10 


(1/30480)2  *40 


.  ,0  1  /  30480  ,0 

sin6  +10 - cos6 

5/254 


<5/254)2  (sin2  3°  + 10 


1/30480  .  ,„,2 
sin6  ) 


2*5/254 


center  10.3 


(II.C.17d) 


1/30480  1 

5/254  sin2  3° 

JW=  24.3  (II.C.17e) 


center  _ 
Y  center 


10.3 

24.3 


-42% 


(II.C.17f) 


This  is  a  big  change  in  the  calibration  factor.  The  reason  for  this  big  change  is  in  the  fact  that 
camera  angle  is  small  and  it  is  zoomed  all  the  way  in.  Also,  the  error  in  camera  angle  is  about  1 
degree,  which  is  about  33%  error.  For  bigger  A pcenter ,  it  will  be  even  worse,  so  we  will  not 
calculate  those  values. 

(ii)  Case  2,  /  =  50  /  2 54(feet) ,  that  is,  camera  is  zoomed  all  the  way  in: 

<»)4fW,=10 
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From  Eqs.(  II.C.7),  (II.C.9),  (II.C.13),  and  (II.C.16),  we  have 


A  ,  /inl/ 30480, 

A  a  =  arctan(10 - )  =  0.096 

50/254 


(II.C.18a) 


10 


Ay: 


2center 


=  -40 


1/30480 

50/254 


.  2 no  in  1/30480  .  0 

sin  3  + 10  ;Sin6 


2*50/254 


AF  2center  —  24  {feet) 


(II.C.  18b) 


A  y 


center 


=  -io 


(1  /  30480)2  *  40 


.  1/ 30480  0 

sm6  + 10 - cos6 

50  /  254  _ 


(50  /  254)"  (sin2r  +  ,0 


1/30480  .  ,„.2 
sm6  ) 


2*50/254 


Ay 


center 


=  -0.148 


(II.C.  18c) 


1/30480  1 

Center  -40  5()/254  ^230 

Y  center  =  2.43  (Il.C.lSd) 


A -Y  center  _ 
Y  center 


0.148 

2.43 


=  -6.1% 


(II.C.  1 8e) 


We  can  see  from  the  above  results  that  for  the  same  number  of  pixel  shift,  the  error  in  the  camera 
angle  allowed  for  case  2  is  far  smaller.  Correspondingly,  The  error  in  the  calibration  factor  is 
substantially  smaller.  Even  though  the  change  in  the  calibration  factor  is  within  the  tolerance  for 

our  purpose,  it  is  not  realistic  because  the  error  in  the  camera  angle  is  normally  more  than  0.5° . 
For  that  reason  and  for  comparison  purpose,  we  will  assume  that  the  error  in  camera  angle  for 

case  2  is  also  0.96°.  Thus,  from  Eqs.(  II.C.7),  (H.C.8),  (II.C.13),  and  (II.C.16),  we  have 
(b)  A  a  =  0.96° 


Accentor 


50/254 

1/30480 


tan  0.96°  =  100 


(II.C.  19a) 
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1/30480 


A)^  2center  40 


100 


50/254 


sin2  3° +100 


1/30480 

2*50/254 


sin  6° 


Ay  2center  =  “185  {feet) 


(II.C.19b) 


Ay 


center 


-100 


•  ,0  1^1/ 30480 

(1  /  30480)2  *  40  Sin6  +  1Q°  50/254  6 


(50/254)  (sin2  3°  + 100 


1/30480  .  ro\2 
sm6  ) 


2*50/254 


Reenter  ="1-03 


(II.C.19c) 


1/30480  1 

/ center  -40  5Q/254  ^30 

y  center  =  2.43  (ILC.19d) 


Ay 


center  __ 


Y  center 


1.03 

2.43 


=  -42% 


(II.C.19e) 


We  can  see  that  the  number  of  pixel  shift  in  this  case  is  about  100,  10  times  of  that  in  the 
previous  case,  but  the  change  in  the  calibration  factor  is  smaller  for  camera  zooming  all  the  way 
in  than  for  camera  zooming  all  the  way  out  with  the  same  camera  angle  and  error  in  the  camera 
angle,  as  discussed  earlier.  Also,  we  can  see  that  the  relative  change  in  calibration  factor  is  about 
the  same.  However,  the  error  in  the  calibration  factor  is  still  substantial. 


From  the  above  results,  we  can  see  that  at  =  3°  is  too  small  for  camera  zooming  all  the 
way  out  (/  =  5/  25 A(  feet)  ).  In  order  to  get  comparable  results  for  this  case,  we  will  compute 
several  camera  angle  values. 


(a)  at  =10°,  Apcenter  =  10 

From  Eqs.(  II.C.7),  (II.C.9),  (II.C.13),  and  (II.C.16),  we  have 

^center  =  40cotl0°  =  221(feet)  (H.C.  20a) 
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A  ,  nnl/  30480,  AA/:0 

A  a  =  arctan(10 - )  =  0.96 

5/254 


(II.C.20b) 


2center 


1/ 30480 

, _ U  5/254 _ 

■  2in0  in  1/30480  .  _.0 
sin  10  + 10 - sm20 

2*5/254 


^center  =-2°(/^0 


(II.  C.  20c) 


(1  /  30480)2  *  40 


sin20°  + 10— 30480  COs20° 
_ 5/254 

.  _  1/30480  . 


(5/254)Z  (sin2 10°  + 10— ——sin  20°) 2 

2*5/254 


^center  =-0*365 

1/30480  1 

^center"40  -2 


(II.C.20d) 


5/254  sin2 10° 


7  center  “  22 1 


(II.C.20e) 


center  __ 


0.365 


=  -16% 


(II.C.20f) 


Thus,  the  calibration  factor  is  about  16%  off  for  10  pixel  shift  on  the  image  plane  at  angle 
a,  =  10° ,  which  is  big. 

(b)  a,  =  20°,  Apcenter  =10 

From  Eqs.(  II.C.7),  (II.C.9),  (II.C.13),  and  (II.C.16),  we  have 


^center  =  40cOt20°  =  110(/^) 


(II.C.21a) 


A  .  nA/  30480,  AA/:0 

A  a  =  arctan(10 - )  =  0.96 

V  5/254 


(II.C.21b) 
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1/30480 


10- 


AV  2center  =  -40 


5/254 


•  1A  1/30480 

sm2  20  + 10  — sin  40 


2*5/  254 


Ay  2center  =  S^feet) 


(II.C.21c) 


center  =  ~10 


.  ,AO  1 / 30480  .n0 

(1  /  30480)2  *  40  sin4Q  +1Q  5/254  C°S4° 

(5/254)2  (Sin220”  +  10-y^«ism40»)2 

v  2*5/254 


Ay  center  =  — 0.049 


(II.C.21d) 


y  center 


1/30480  1 

5/254  sin2  20° 


y  center  ^.57 


(II.C.2  le) 


A/  center  _  _  _  _g 

Y  center  0.57 


(II.C.2  If) 


The  relative  change  in  calibration  factor  is  smaller  in  this  case.  For  dt  —  1  /  15(sec),  this  angle 
is  still  within  the  maximum  camera  angle  allowed  as  computed  in  Eq.(  II.C.8a).  However,  this 
angle  is  bigger  than  the  maximum  angle  allowed  as  computed  in  Eq.(II.C.lOa)  for 

dt-M  3(sec). 

D.  Compensation  of  Calibration  Factor  with  regard  to  the  Camera  Perspective 

From  Eq.(II.12b),  we  see  that  the  calibration  factor  y  is  a  nonlinear  function  of  the  pixel 
position  p.  Because  the  ROI  which  the  algorithm  uses  to  compute  flow  speed  is  large,  we  need 

to  compensate  for  the  difference  in  calibration  factors  in  different  pixel  positions.  From 
Eq.(II.16a),  we  can  see  that  if  we  can  know  coefficients  a  and  b,  we  will  know  precisely  the 
calibration  factor  for  each  pixel  position.  Coefficients  a  and  b  can  be  obtained  using  Eq.(II.16b) 
if  we  know  the  camera  angle.  However,  it  is  very  hard,  if  possible,  in  practice  to  measure  the 
camera  angle  accurately.  Therefore,  we  have  to  compute  a  and  b  empirically. 

There  are  four  methods  of  obtaining  a  and  b  this  way.  The  first  method  sets  up  two  rulers 
at  two  places  on  the  roadway  for  the  calibration.  The  second  and  fourth  methods  assume  that  the 
average  and  the  median  of  the  pixel  shifts  of  all  the  vehicles  in  the  ROI  in  one  frame  to  be  the 
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pixel  shift  computed  with  the  correlation  algorithm,  respectively,  then  use  Eqs.(H.12a),  (II.  16a), 
and  (II.  16b)  to  obtain  a  and  b.  The  third  method  assumes  that  the  average  of  all  the  vehicle 
positions  in  the  ROI  in  one  frame  is  the  place  where  the  pixel  shift  computed  by  correlation 
algorithm  occurs,  then  uses  Eqs.(II.  12a),  (II.  16a),  and  (II.  16b)  to  obtain  a  and  b.  The  first  method 
is  based  on  the  fact  that  the  calibration  factor  depends  only  on  the  geometry  of  the  roadway,  the 
camera  position,  and  camera  angle.  The  second,  third,  and  fourth  methods  use  the  vehicle  speed 
for  the  calibration.  We  will  discuss  the  four  methods  in  detail  in  the  following.  For  simplicity,  we 
will  call  the  pixel  shift  computed  by  correlation  algorithm  as  the  overall  pixel  shift. 

(a)  Set  up  two  calibration  points  in  an  ROI 

Because  the  calibration  factor  depends  only  on  the  geometry  of  the  roadway  and  the 
camera  position  and  not  the  vehicle  speed,  we  can  just  set  up  rulers  at  two  places  on  the  roadway 
to  compute  the  calibration  factor.  Assume  that  we  set  up  two  calibration  rulers,  with  equal 

distance,  c  feet,  at  two  calibration  points,  p®{  and  p® ,  and  the  corresponding  pixel  difference  are 
dp®  and  dp® ,  respectively.  Thus  we  can  obtain  two  calibration  factors  y®  and  y °2  as  follows: 

(II.D.la) 


(II.D.lb) 


With  the  two  calibration  factors,  we  can  get  from  Eq.(II.16a) 


and 


Thus, 


and 


Eqs.(  II.D.3a)  and  (II.D.3b)  are  based  on  the  two  manually  setup  calibration  points. 
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The  above  method  uses  two  calibration  points  for  obtaining  a  and  b.  It  does  not  need  to 
know  if  vehicles  are  present  at  the  scene  since  calibration  factor  depends  only  on  the  roadway 
geometry,  the  camera  position,  and  its  angle.  However,  since  we  can  determine  the  pixel 
displacement  of  a  vehicle  in  a  ROI  in  two  correlated  frames  with  the  correlation  method,  we  will 
know  the  calibration  factor  if  we  know  the  corresponding  vehicle  displacement  on  the  roadway. 
Because  the  vehicle  displacement  is  equal  to  the  vehicle  speed  times  the  time  it  takes  to  travelled 
that  distance  and  that  time  is  the  same  as  the  timing  between  two  correlated  frames,  which  we 
already  know,  we  will  know  the  vehicle  displacement  if  we  know  the  vehicle  speed.  This  gives 
us  the  possibility  of  using  flow  speed  to  do  the  calibration.  In  the  following  three  methods,  we 
will  use  flow  speed  for  the  calibration. 

Assume  that  there  are  M  vehicles  in  the  ROI  in  one  frame  with  pixel  positions  pi , 
i  =  0,...,  M  -  1 .  The  corresponding  calibration  factors  are  yf,  i  =  0,...,  M  - 1 .  The  overall 
pixel  shift  is  dp .  Also,  all  the  vehicles  travel  at  the  same  speed  v  and  the  time  between  two 

correlated  frames  is  dt .  We  have  three  ways  of  compensating  for  the  perspective.  They  are  as 
follows. 

(b)  The  average  of  the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame  is  the  overall  pixel  shift 

The  first  method  averages  over  the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame  and 
regards  it  as  the  overall  pixel  shift.  With  this  method,  we  have 


From  Eq.(  II.D.4),  We  have 

M  dp  dp 

v"‘VTdT/d<' 

h  y, 


where 


(II.D.5) 


y — 

h  Yi 


is  the  equivalent  calibration  factor  for  the  whole  ROI  with  M  vehicles  in  the  ROI. 
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Or,  with  Eq.(II.16a), 


(II.D.6b) 


Z(«+^a): 


Plug  Eq.(  II.D.7a)  into  Eq.(II.14b),  we  get 


mph=hwtjl_ 

22  Z (a  +  bp,? 

/=0 


(II.D.6c) 


From  Eq.(  II.D.6c),  we  see  that  the  MPH  varies  according  to  the  number  of  vehicles 
present  and  their  positions  on  the  image  plane,  which  is  in  contrast  to  our  current  constant  MPH 
method.  Our  constant  MPH  method  is  a  limit  case  of  Eq.(  II.D.6c)  when  there  is  only  a  vehicle 
and  its  position  is  in  the  center  of  the  ROI  in  one  frame  or  when  the  vehicles  are  evenly 
distributed  across  the  ROI  in  one  frame. 

We  see  from  the  above  that  the  calibration  factor  y  as  defined  in  Eq.(  n.D.6a)  is  the 

average  calibration  factor  for  the  whole  ROI.  It  is  not  the  ordinary  average,  but  in  the  same  form 
as  in  the  parallel  resistors  case.  From  Eq.(  II.D.6b),  we  see  that  as  long  as  we  know  the 
coefficients  a  and  b  and  the  vehicle  positions,  we  know  the  average  calibration  factor  for  the 
ROI,  thus  the  accurate  flow  speed. 

We  can  use  the  method  described  in  (I)  to  obtain  coefficients  a  and  b.  We  can  also  use 
Eqs.(  II.D.5)  and  (II.D.6b)  to  obtain  a  and  b.  For  that  purpose,  we  will  express  Eqs.(II.D.5)  and 
(II.D.6b)  as  an  equation  for  a  and  b.  Plug  Eq.(  II.D.6b)  into  Eq.(  II.D.5),  We  have 


M 

M- 1 

Z  (a  +  bp,y 

i=0 


(II.D.7) 


Express  Eq. (II.D.7)  as  a  quadratic  function  on  a  and  b,  we  get 

M- 1  M- 1 

Za  Zrf  . 

a1+ab^—  +  62-!=2 —  =  -22- 

M  M  vdt 


(II.D.8) 


Eq.(  II.D.8)  is  a  2-variable  order  2  nonlinear  equation  on  a  and  b.  To  solve  for  a  and  b,  we  need 
two  equations.  For  that  purpose,  we  set  up  two  adjacent  ROI’s,  ROI  0  and  ROI  1.  Assume  that 
there  are  M0  and  Ml  vehicles  in  ROI  0  and  ROI  1  in  one  frame  and  their  pixel  positions  are 
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p0i  and  pXj,  i  =  0,...,MQ  -  1,  j  =  0,...,  Mx  -  1 ,  respectively.  Also,  the  corresponding  pixel 

shifts  computed  by  the  correlation  algorithm  are  dp0,  and  dpx ,  respectively,  and  the  flow  speed 
is  V .  Thus, 


and 


(II.D.9a) 


(II.D.9b) 


From  Eqs.(  II.D.9a)  and  (II.D.9b),  we  can  solve  for  a  and  b.  However,  it  is  difficult  to  solve  for  a 
and  b  using  the  above  equations  when  A/0  and  Mx  are  all  greater  than  1.  This  is  especially  true 
when  we  use  multi-measurements  to  solve  for  a  and  b  as  will  be  discussed  later.  Nontheless, 
when  either  Mq  or  K4 x  or  both  equal  1 ,  it  is  easy  to  solve  for  a  and  b.  Assume  they  are  both  1 
(for  either  one  of  them  is  1,  the  derivation  is  straightforward),  then  from  Eqs.(  II.D.9a)  and 
(II.D.9b),  we  get 


a1  +  abp00  +  b2p200 


dp 


0 


(II.D.lOa) 


and 


q1  +  ctbpx0  +  b2p20  — 


vdt 

dp\ 

vdt 


(II.D.lOb) 


or 


and 


a  +  bp{ 


oo 


a  +  bpxo  = 


\dPo 

vdt 

W\ 

vdt 


(II.D.lla) 


(II.D.llb) 


It  is  straightforward  to  solve  the  above  equations  for  a  and  b.  Solving  Eqs.(  II.D.l  la)  and 
(II.D.llb)  yields 
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(II.D.  12a) 


(Pio-Poo)Jvdi 

and 

b=  ■Wi-Jdp* 

(Ao  -  Poo)Jvdi 


(II.D.  12b) 


The  derivation  of  Eqs.(  n.D.  12a)  and  (II.D.  12b)  requires  that  there  be  only  one  vehicle  in 
each  ROI  in  one  frame.  In  order  to  satisfy  this  requirement,  the  ROI’s  have  to  be  small  enough  to 
contain  one  vehicle  at  a  time.  This  can  be  done  by  defining  the  ROI  to  be  a  little  bit  larger  than  a 
vehicle.  However,  this  is  a  serious  drawback  since  if  the  ROI  is  too  small,  the  waveform  will  be 
distorted  significantly  due  to  the  leakage  and  influx  of  vehicles  unless  the  timing  between  two 
correlated  frames  is  small,  in  which  case  the  pixel  shift  will  be  small,  but  the  accuracy  of  our 
flow  speed  computation  will  be  reduced. 


In  the  above,  we  use  only  one  measurement  for  the  computation  of  a  and  b.  In  reality,  the 
measurement  will  be  corrupted  by  noise  and  other  errors,  so  we  need  to  take  many  measurements 
and  do  some  type  of  processing  to  obtain  a  and  b.  We  will  describe  two  ways  of  doing  it  in  the 
following: 


(i)  Averaging 

Since  each  ROI  is  small  enough  to  allow  only  one  vehicle  in  it,  the  multiple 
measurements  of  the  positions  should  be  very  close.  Thus,  we  could  just  simply  average  the 
measurements  to  obtain  only  one  value  for  each  quantity.  Assume  that  we  take  N  measurements 
and  the  readings  of  the  vehicle  positions  and  the  overall  pixel  shifts  for  ROI  0  and  1  are  p0i , 
Pn  >  dps, ,  and  dph ,  /  =  0,-  •  •,  N  - 1 ,  and  the  corresponding  average  positions  and  overall 
pixel  shifts  are  p0,  px ,  dp0 ,  and  dpx  ,  respectively.  Also,  the  N  measurements  of  the  flow 
speeds  are  ,  /  =  0,*  •  •,  N  - 1 ,  and  its  average  value  is  v .  Then, 


1  N- 1 

v  =  -Zv, 

A  ;=  0 

_  1  N-l 

Po  =  T7  ZA» 

A  /=o 


(II.D.  13a) 

(II.D.  13b) 


_  1  N-l 

P'  =  N^ 


(II.D.  13c) 
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(II.D.  13d) 


_  1  N- 1 

4>o=-tt2> 

-A  /= 0 


0/ 


and 


_  i  AM 

^A=T7ErfA, 

#  i=0 


(II.D.13e) 


Thus,  using  Eqs.(  II.D.  12a)  and  (II.D.  12b)  and  Eqs.(13a)-(e),  we  have 


(Pi~Po)^dt 


and 


(II.D.  14a) 


(II.D.  14b) 


(ii)  Least  Square  Fitting 

We  can  also  use  least  square  fitting  to  obtain  a  and  b.  In  this  case,  only  one  ROI  is 
needed.  Assume  the  same  measurements  for  ROI  0  as  in  (i).  The  sum  of  the  squared  error  of  each 
individual  measurement  is 


«=Z 


£o  V  vidt 


Differentiate  over  a  and  b,  we  have 

de 


N- 1 

<3i”-2SS| 


dp„, 


Vjdt 


and 


N- 1 


cb  2SS 


dp0l 


V;dt 


-a-  bp0j ) 


-a-bp0i)p0i 


For  e  to  be  minimum,  we  require 


(II.D.  15) 


(II.D.  16a) 


(II.D.  16b) 
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(II.D.17a) 


and 


(II.D.17b) 


Thus,  from  Eqs.(  II.D.16a),  (II.D.16b),  (II.D.17a),  and  (II.D.17b),  we  get 


N-i  N- 1 

/= o  /=o  V  vidt 


and 


«I>o/+*IX  =  Sa>,. 

7=0 


N-\  N- 1 

.2 


7=0 


7=0 


(II.D.18a) 


(II.D.18b) 


Solve  Eqs.(  II.D.  1 8a)  and  (II.D.  1 8b)  for  a  and  b,  we  have 


and 


a  = 


AM  AM 

(Z,plXZv 

1=0  V 


/=0 


dry  n- l  tf-i 

^)-(2>o,)LO% 


7=0  /=0 


» 


V,<# 


AM  AM 

*2>2-(W 


7=0 


7=0 


1=0 


dp§i  \  /V'1^  \/T'1  1^1 


V,^ 


)-(Z/?o,)(Z. 

7=0  7=0 


Oi 


vAt 


AT-l  JV-1 

"Sp2-(Spo,)2 


7=0 


7=0 


(II.D.  19a) 


(HD.  19b) 


In  the  above,  we  discussed  the  averaging  over  pixel  shifts  method.  In  this  method,  it  is  difficult 
to  solve  for  coefficients  a  and  b  analytically  with  multiple  vehicles  in  the  ROI  in  one  frame.  It  is 
especially  difficult  when  we  use  multi-measurements  with  least  square  fitting  to  solve  for  a  and  b 
because  it  is  a  nonlinear  2-variable  order  2  equation.  To  get  around  this  problem,  we  make  the 
ROI  small  enough  for  just  one  vehicle.  The  drawback  with  this  is  that  it  can  not  tolerate  even  a 
small  camera  angle  error,  which  will  totally  shift  the  ROI  when  we  come  back  to  the  original 
preset  value.  Also,  this  will  not  allow  for  close  range  ROI  because  the  vehicle  will  be  moving  so 
fast  that  it  will  move  out  of  the  ROI  even  within  two  consecutive  frames.  The  biggest  problem 
with  this  is  that  due  to  the  correlation  method,  the  ROI  has  to  be  big  enough  to  allow  a  vehicle  to 
stay  inside  the  ROI  for  several  correlated  frames.  This  means  that  the  ROI  has  to  be  much  larger 
than  one  vehicle  for  the  vehicle  to  shift  and  still  be  in  the  ROI  for  several  correlated  frames.  This 
will  generally  require  that  the  ROI  be  several  times  larger  than  a  vehicle  length.  Thus,  it  will 
cause  error  by  using  Eqs.(  II.D.  19a)  and  (II.D.  19b)  to  compute  a  and  b.  Therefore,  we  will  not 
use  this  method  for  calibration. 
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(c)  The  overall  pixel  shift  occurs  at  the  average  of  the  pixel  positions  of  all  vehicles  in  the  ROI 
in  one  frame 

In  the  above  method,  we  average  over  the  pixel  shifts  of  all  the  vehicles  in  the  ROI  in  one 
frame  and  take  it  as  the  overall  pixel  shift.  However,  for  obtaining  a  and  b  with  multiple 
measurements,  this  method  is  awkward  unless  we  use  a  ROI  small  enough  for  just  one  vehicle  as 
described  above.  Even  in  this  case,  the  region  still  has  to  be  bigger  than  a  vehicle  in  order  for  the 
correlation  to  work.  Thus,  we  can  not  guarantee  that  only  one  car  present  at  a  time.  There  may  be 
part  of  another  vehicle  present  at  the  same  time,  which  causes  error  in  the  perspective 
compensation.  Hence,  the  above  method  is  not  a  good  method  for  calibration.  In  this  subsection, 
we  will  discuss  another  method,  averaging  over  the  pixel  positions  of  all  the  vehicles  in  the  ROI 
in  one  frame.  This  method  assumes  that  the  average  of  the  pixel  positions  of  all  the  vehicles  in 
the  ROI  in  one  frame  to  be  the  place  where  overall  pixel  shift  occurs. 

In  this  method,  we  need  only  one  region.  For  each  measurement,  we  average  over  all  the 
vehicle  positions  in  the  ROI  in  one  frame  to  get  a  single  position  value,  then  we  assume  that  the 
overall  pixel  shift  corresponds  to  that  average  position.  The  problem  is  then  equivalent  to  a 
single  vehicle  in  that  average  position  in  the  ROI  as  in  case  (b)(ii).  Thus,  all  the  formulas  there 
are  applicable  here,  except  that  the  vehicle  position  pQj  in  the  ROI  for  each  measurement  in  case 
(b)(ii)  is  replaced  by  the  average  position  of  the  multiple  vehicles  in  the  ROI  for  each 
measurement.  Assume  that  we  take  N  measurements  and  there  are  M{  vehicles  at  the  ith 
measurement.  Let  Py ,  i  =  0,*  •  *,  N  —  1  and  j  =  0,*  “,Mi  —  1 ,  be  the  jth  vehicle  position  for 
the  ith  measurement  and  dpi  and  V, ,  /  =  0,*  •  *,  N  —  1 ,  be  the  overall  pixel  shift  and  vehicle 

speed  for  the  ith  measurement.  In  addition,  let  pi  and  y  t ,  i  =  (),•  •  ♦,  N  - 1 ,  be  the  average  pixel 
position  and  its  corresponding  calibration  factor  for  measurement  i,  respectively.  Then,  the 


average  pixel  position  for  measurement  i  is 

_  j  Mr- 1 

Pi=-rrLPij 

Mi  >0 

(II.D.20) 

Thus, 

dPi  =  -  =  {a  +  b~Pj)2  Vjdt 

Yx 

(II.D.21) 

or 

v  1  dPi 

(o  +  bpi )  dt 

(II.D.22) 

We  will  use  least  square  method  to  solve  for  a  and  b.  The  equations  that  we  are  going  to  derive 
are  essentially  the  same  as  those  in  case  (b)(ii).  The  sum  of  the  squared  error  of  each  individual 
measurement  is 


92 


N- 1  Un  _ 

e=ZL— r-(o+*p,)l2 

i= 0  V  V/«* 


Differentiate  over  a  and  b,  we  have 


and 


de 

cfo 


mum- 


/to  v  Vidt 


bpdPi 


For  e  to  be  minimum,  we  require 


f=0 


and 


=  0 


Thus,  from  Eqs.(  II.D.24a),  (II.D.24b),  (II.D.25a),  and  (II.D.25b),  we  get 


N-l_  N- 1 

i=o  7=o  v  V/dt 


and 


'dPi 


N- 1 AM ,  AM 

oEaMZa  =  EaAIv 

»=o  /=o  i= o  V  v/“^ 


Solve  Eqs.(  II.D.26a)  and  (II.D.26b)  for  a  and  b,  we  have 


a 


-  ,=0  (=o  y  Vjdt  ,-=0  i=Q  y  v,dr 


AM 


NY,P,2  -CLPiY 

i= 0  7=0 


AM 


and 


(II.D.23) 

(II.D.24a) 

(II.D.24b) 

(II.D.25a) 

(II.D.25b) 

(II.D.26a) 

(II.D.26b) 

(II.D.27a) 
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(II.D.27b) 


b  = 


N- 1  _ 

NZ(P, 

i= 0 


rin  N~l—  N~l 

%)-(ZaXZ. 
V,£#  ,-=0  i=0  V 


dPt 


v,dt 


N- 1_,  tf-l_  „ 

ivZp,  -Q>,)2 


1=0 


/=0 


With  Eqs.(  II.D.20),  (II.D.27a),  and  (II.D.27b),  we  can  solve  for  a  and  b.  After  we  have  known  a 
and  b,  we  could  use  Eqs.(  II.D.20)  and  (II.D.22)  to  determine  the  flow  speed. 

(d)  The  median  of  the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame  is  the  overall  pixel 
shift 

In  this  subsection,  we  will  discuss  the  fourth  method,  which  assumes  that  the  median  of 
the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame  is  the  overall  pixel  shift.  This  method  is  a 
preferred  method  since  it  is  based  on  a  proof  for  the  same  result  in  the  flow  speed  computation. 
However,  because  the  proof  is  based  on  some  ideal  assumptions  which  include  uniform  intensity 
for  all  vehicles,  small  pixel  shift,  and  large  separation  between  vehicles,  etc,  the  result  may  not 
hold  for  the  actual  situation.  Therefore,  we  can  not  claim  that  this  method  is  an  accurate  one. 

Assume  that  we  make  N  measurements  and  there  are  Mi  vehicles  at  the  ith 
measurement.  Let  pim  and  yim ,  i  =  0,-  •  -,N  - 1 ,  be  the  position  of  the  median  of  the  pixel 
shifts  of  all  vehicles  in  the  ROI  and  its  corresponding  calibration  factor  in  the  ith  measurement, 
and  dpj  and  V,  ,  /  =  - 1,  be  the  overall  pixel  shift  and  vehicle  speed  for  the  ith 

measurement,  respectively.  Thus,  dpt  and  pim  are  related  by  the  following  relationship 


dp  -  =  (a  +  bpim)2Vjdt 

Yim 

(II.D.28) 

V  1  dPi 

'  (a  +  bpj2  dt 

(II.D.29) 

Comparing  Eq.(II.D.21)  with  Eq.(II.D.28),  we  can  that  the  difference  between  this 
method  and  the  third  method  is  in  how  we  relate  the  overall  pixel  shift  to  the  pixel  position.  In 
the  third  method,  we  assume  that  the  overall  pixel  shift  corresponds  to  the  average  pixel  position 
of  all  vehicles  in  the  ROI  in  one  frame,  while  in  this  method,  we  relate  the  overall  pixel  shiftto 

the  median  of  the  pixel  shifts  of  all  vehicle  in  the  ROI  in  one  frame.  Therefore,  if  we  replace  pt 
by  pjm  in  all  the  equations  in  Subsection  (c),  we  will  get  the  formulas  for  this  method.  Thus  with 
least  square  fitting,  we  can  get  the  equations  for  obtaining  a  and  b  from  Eqs.(II.D.27a)  and 
(II.D.27b)  as  follows. 
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With  Eqs.(II.D.30a)  and  (II.D.30b),  we  can  compute  the  coefficients  a  and  b.  After  we 
obtain  a  and  b,  we  will  know  the  calibration  factor  for  each  individual  pixel  position  with 
Eq.(II.  16a).  The  flow  speed  is  then  determined  by  determining  the  pixel  position  corresponding 
to  the  median  of  the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame. 

In  the  above,  we  discuss  four  methods  for  determining  the  coefficients  a  and  b.  The  first  method 
has  a  merit  in  that  it  straightforwardly  determines  a  and  b  with  rulers  at  two  calibration  points. 

The  second,  third,  and  fourth  methods  use  the  flow  speed  for  calibration.  With  the  second 
method,  the  pixel  shifts  of  all  vehicles  in  the  ROI  in  one  frame  is  averaged  and  the  average  pixel 
shift  is  taken  as  the  overall  pixel  shift.  We  then  derived  a  set  of  equations  for  determining  a  and 
b.  This  method  has  a  disadvantage  in  that  it  is  very  complex  for  solving  a  and  b  analytically, 
especially  in  the  case  of  mutiple  measurements. 

The  third  method  and  the  fourth  method  are  very  similar  in  the  way  they  relate  the  overall  pixel 
shift  to  the  pixel  position.  The  third  method  assumes  that  the  pixel  position  corresponding  to  the 
overall  pixel  shift  is  the  average  pixel  position  of  all  vehicles  in  the  ROI  in  one  frame,  while  the 
fourth  method  relates  the  overall  pixel  shift  to  the  pixel  position  where  the  median  pixel  shift  of 
all  vehicles  in  the  ROI  in  one  frame  is  at.  These  two  methods  are  equivalent  when  the  traffic  is 
heavy  since  in  that  case  the  average  pixel  position  of  all  vehicles  in  the  ROI  in  one  frame  is  the 
same  or  very  close  to  pixel  position  corresponding  to  the  median  pixel  shift.  However,  they  may 
be  quite  different  when  the  traffic  is  light,  since  in  that  case  the  pixel  position  corresponding  to 
the  median  pixel  shift  may  be  quite  far  away  from  the  average  pixel  position.  Nontheless,  we 
expect  these  two  methods  to  perform  about  the  same  in  a  long  period  of  time  due  to  the  average 
nature  of  these  methods.  This  is  especially  true  if  we  use  the  same  method  for  obtaining  a  and  b 
and  for  computing  flow  speed. 

Either  method  (c)  or  method  (d)  can  be  used  for  perspective  compensation.  However,  due 
to  the  proof  in  the  flow  speed  computation,  we  believe  that  method  (d)  is  closer  to  the  actual 
situation  than  method  (d).  Therefore,  we  will  use  method  (d)  for  our  perspective  compensation. 

6.3  Conclusions 
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In  section  6  of  this  technical  report,  we  discuss  the  camera  perspective  with  respect  to 
flow  speed  computation.  From  the  various  equations  derived  in  the  above,  we  can  have  several 
conclusions. 

(a)  Even  though  the  camera  angle  is  limited  by  the  requirement  that  the  vehicles  in  the  ROI  have 
to  stay  in  that  ROI  for  specific  number  of  times,  the  distance  that  it  can  see  is  still  close  enough. 
The  closest  distance  that  the  camera  can  see  while  still  satisfying  the  requirement  is  around  100 

feet. 

(b)  The  pole  high  is  not  a  big  factor  with  respect  to  camera  perspective.  However,  due  to  the 
obstructions  along  the  highway,  such  as  a  sign,  a  light  pole,  or  trees,  the  higher  the  pole,  the 
better.  The  suitable  pole  height  will  be  about  60  feet. 

(c)  The  error  in  the  pixel  position  due  to  the  error  in  camera  angle  is  independent  of  the  camera 
angle  itself.  The  calibration  factor  is  sensitive  to  the  error  in  the  camera  angle.  For  the  same 
angle  and  same  error  in  camera  angle,  zooming  in  is  less  sensitive  than  zooming  out.  Also,  the 
higher  the  camera  angle,  the  less  sensitive  the  calibration  factor  to  the  error  in  the  camera  angle. 

(d)  The  camera  perspective  in  flow  speed  computation  can  be  compensated  by  determining  the 
number  of  vehicles  and  their  positions  in  the  ROI  in  each  set  of  correlated  frames.  The  best  way 
to  obtain  the  coefficients  a  and  b  for  calibration  factor  is  by  determining  the  pixel  position 
corresponding  to  the  median  pixel  shift  of  all  vehicles  in  the  ROI  in  each  set  of  correlated  frames 
and  then  using  least  square  fitting  method. 
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